-- Logs begin at Wed 2022-06-15 13:46:03 UTC, end at Wed 2022-06-15 15:15:12 UTC. -- Jun 15 14:46:40.996524 dv-cinder-845178-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:46:41.006356 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:46:41 2022] *** Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: nodename: dv-cinder-845178-7-iscsi Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: machine: x86_64 Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: clock source: unix Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: pcre jit disabled Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: detected number of CPU cores: 4 Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: current working directory: / Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: your processes number limit is 47680 Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: your memory page size is 4096 bytes Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: detected max file descriptor number: 2048 Jun 15 14:46:41.007148 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: lock engine: pthread robust mutexes Jun 15 14:46:41.008069 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: thunder lock: enabled Jun 15 14:46:41.008069 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:46:41.008069 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:46:41.051021 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: Python main interpreter initialized at 0x55c4a82379c0 Jun 15 14:46:41.051021 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: python threads support enabled Jun 15 14:46:41.051021 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: your server socket listen backlog is limited to 100 connections Jun 15 14:46:41.051021 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:46:41.051445 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:46:41.051445 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: *** Operational MODE: preforking *** Jun 15 14:46:41.051721 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:46:41.051721 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: spawned uWSGI master process (pid: 110271) Jun 15 14:46:41.051936 dv-cinder-845178-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:46:41.058213 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: spawned uWSGI worker 1 (pid: 110272, cores: 1) Jun 15 14:46:41.058213 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: spawned uWSGI worker 2 (pid: 110273, cores: 1) Jun 15 14:46:41.058213 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:46:41.740510 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:46:41.759252 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:46:42.928090 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:46:42.928090 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: from cryptography.utils import int_from_bytes Jun 15 14:46:42.928689 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:46:42.928689 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: from cryptography.utils import int_from_bytes Jun 15 14:46:42.956746 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:46:42.956746 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: from cryptography.utils import int_from_bytes Jun 15 14:46:42.957245 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:46:42.957245 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: from cryptography.utils import int_from_bytes Jun 15 14:46:45.629558 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:46:45.630371 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:46:45.630371 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:46:45.630703 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:46:45.630959 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:46:45.631344 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.631668 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.631986 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.632300 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.632629 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.632938 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.633866 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.634203 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.634309 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:46:45.634672 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.634750 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:46:45.634822 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.635078 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:46:45.635241 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.635423 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-7-iscsi {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.635513 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:46:45.635743 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.635836 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:46:45.636046 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.636353 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.636443 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.636672 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.636818 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.636973 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.637072 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.637292 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.637381 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.637596 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.637711 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.638026 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.638123 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.638379 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.638539 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.638703 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.638843 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.639034 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.639157 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.639297 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.639486 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.639597 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.639795 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.639920 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-7-iscsi {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.640110 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.640237 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.640417 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.640546 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.640721 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.640856 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.641044 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.641178 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.641348 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.641522 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.641754 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-7-iscsi {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.641897 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.642068 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.642158 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.642407 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.642625 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.642723 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.642938 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.643118 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.643244 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.643426 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.643553 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.643738 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.643891 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.644060 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.644206 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.644380 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.644514 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.644687 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.644834 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.645011 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.645142 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.645328 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.645464 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.645646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.645773 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.645964 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.646200 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-7-iscsi {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.646289 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.646523 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.646617 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.646835 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.646928 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.647149 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.647235 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.647481 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.647572 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.647783 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.647874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.648032 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.648154 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.648336 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.648476 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.648670 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.648866 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.649108 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.649496 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.649584 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.649675 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.649759 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.649843 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.649989 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.650160 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.650282 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.650520 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.650606 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.650826 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.650967 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.651131 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.651264 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.651434 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.651525 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.651756 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.651896 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.652042 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.652127 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.652344 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.652436 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.652633 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.652726 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.652937 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.653021 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.653254 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.653338 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.653571 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.653656 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.653890 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.653974 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.654142 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.654252 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.654436 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.654530 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.654761 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.654902 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.655087 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.655180 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.655397 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.655482 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.655708 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.655793 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.656017 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.656110 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.656325 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.656410 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.656631 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.656722 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.656939 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.657035 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.657246 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.657329 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.657549 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.657640 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.657854 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.657947 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.658185 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.658294 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.658517 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.658608 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.658821 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.658908 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.659070 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.659160 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.659370 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.659531 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.659671 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.659785 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.659986 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.660197 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.660307 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.660439 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.660579 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.660759 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.660879 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.661186 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.661294 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.661426 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.661594 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.661703 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.661843 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.662012 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.662109 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.662348 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.662443 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.662646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.662730 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.662948 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.663033 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.663256 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.663342 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.663558 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.663651 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.663818 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.663901 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.664120 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.664212 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.664514 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665187 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665284 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665365 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665455 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665535 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665618 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665708 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665793 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665871 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.665968 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.666081 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.666282 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.666421 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.666588 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.666729 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.666907 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.667036 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.667211 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.667344 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.667514 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.667650 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.667830 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.667956 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.668135 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.668290 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.668439 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.668571 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.668756 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.668877 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.669055 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.669198 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.669356 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.669520 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.669672 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.669828 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.669976 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.670134 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.670397 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.670516 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.670707 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.670800 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.671011 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.671104 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.671313 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.671410 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.676499 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.676631 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.676726 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.676808 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.676886 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.676974 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677060 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677149 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677149 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677310 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677396 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677480 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677557 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677633 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677709 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677785 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677869 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.677946 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678028 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678111 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678212 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678308 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.678401 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678485 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.678563 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678645 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.678728 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678805 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.678895 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.678981 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.679066 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.679144 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.679226 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.679226 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.679382 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.679460 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.679543 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.679620 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.679696 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.679781 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.679859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.680440 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.680539 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.680539 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.680681 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.680765 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.680850 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.680928 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681005 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.681081 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681158 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:46:45.681247 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681331 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681409 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681492 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681576 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681653 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681719 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681795 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681870 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.681946 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682071 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682222 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682308 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682386 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682489 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682581 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682670 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682839 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.682926 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.683006 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.683260 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.683361 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.683554 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.683689 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.683861 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.683978 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.684189 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.684282 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.684499 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.684598 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.684809 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.684905 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.685118 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.685214 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.685441 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.685537 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.685766 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.685854 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.686076 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.686271 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.686418 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.686509 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.686729 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.686829 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.687041 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.687137 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.687351 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.687549 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.687661 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.687964 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.688060 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.688318 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.688415 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.688629 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.688714 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.688942 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.689037 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.689251 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.689355 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.689566 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.689654 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.689876 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.689963 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.690203 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.690295 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.690517 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.690605 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.690823 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.690912 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.691129 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.691218 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.691432 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.691525 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.691742 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.691830 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.692045 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.692181 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.692364 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.692462 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.692677 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.692771 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.692992 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.693080 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.693322 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.693415 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.693627 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.693721 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.693937 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.694079 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.694256 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.694447 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.694582 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.694729 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.694888 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.695019 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.695184 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.695317 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.695500 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.695691 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.696440 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.696575 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.696786 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.696931 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.697101 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.697247 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.697412 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.697552 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.697737 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.697871 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.698043 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.698259 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.698483 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.698617 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.698761 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.698906 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.699062 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.699204 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.699345 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.699480 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.699614 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.699748 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.699898 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.700035 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.700173 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.700315 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.700459 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.700594 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.700753 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.700887 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.701088 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.701220 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.701420 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.701558 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.701728 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.701883 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.702054 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.702214 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.702402 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.702516 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.702723 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.702818 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.703028 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.703115 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.703337 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.703433 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.703639 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.703739 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.703945 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.704043 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.704248 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.704343 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.704554 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.704641 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.704856 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.704949 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.705159 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.705255 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.705461 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.705548 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.705764 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.705857 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.706066 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.706154 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.706410 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.706498 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.706717 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.706813 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.707019 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.707107 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.707323 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.707417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.707623 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.707710 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.707965 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.708062 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.708268 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.708355 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.708573 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.708669 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.708883 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.708978 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.709191 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.709278 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.709501 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.709601 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.709810 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.709897 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.710118 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.710223 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.710451 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.710605 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.710757 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.710893 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.711054 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.711197 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.711442 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.711652 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.711778 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.711868 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.712147 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.712349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.712509 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.712769 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.712908 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.713053 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.713053 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.713309 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.713456 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.713592 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.713724 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.713858 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.714015 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.714142 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.714330 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.714481 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.714625 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.714756 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.714938 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.715091 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.715253 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.715350 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.715573 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.715661 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.715884 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.716019 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.716194 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.716326 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.716500 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.716628 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.716808 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.716956 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.717116 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.717247 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.717424 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.717553 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.717735 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.717886 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.718061 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.718204 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.718402 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.718530 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.718710 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.718867 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.719016 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.719146 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.719321 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.719460 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.719634 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.719774 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.719937 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.720069 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.720251 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.720341 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.720577 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.720717 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.720909 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.721042 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.721217 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.721356 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.721526 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.721666 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.721836 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.721967 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.722152 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.722343 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.722487 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.722653 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.722796 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.722937 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.723088 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.723225 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.723411 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.723556 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.723717 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.723811 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.724031 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.724141 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.724342 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.724441 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.724646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.724735 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.724952 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.725050 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.725264 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.725353 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.725573 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.725662 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.725875 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.725974 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.726194 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.726286 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.726509 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.726611 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.726861 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.726965 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.727192 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.727330 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.727483 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.727579 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.727797 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.727894 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.728104 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.728191 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.728412 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.728502 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.728725 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.728824 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.729042 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.729131 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.729353 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.729451 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.729664 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.729752 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.729966 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.730054 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.730303 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.730393 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.730623 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.730721 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.730928 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.731015 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.731231 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.731426 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.731527 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.731616 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.731840 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.731927 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.732148 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.732244 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.732459 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.732547 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.732782 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.732880 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.733086 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.733208 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.733391 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.733522 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.733714 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.733830 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.734100 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.734306 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.734417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.734587 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.734687 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.734844 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.734933 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.735150 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.735304 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.735456 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.735591 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.735767 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.735897 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.736075 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.736206 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.736382 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.736514 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.736683 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.736836 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.736977 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.737110 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.737290 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.737424 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.737663 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.737872 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.738005 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.738225 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.738625 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.738801 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.738888 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.739121 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.739214 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.739440 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.739542 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.739759 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.739898 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.740067 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.740198 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.740395 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.740526 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.740711 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.740852 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.741067 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.741224 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.741369 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.741502 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.741633 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.741764 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.741924 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.742056 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.742231 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.742374 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.743118 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.743389 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.743547 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.743728 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.743934 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.744070 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.744203 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.744335 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.744485 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.744659 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.744814 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.744983 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.745128 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.745291 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.745432 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.745607 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.745748 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.745910 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.746044 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.746270 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.746419 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.746562 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.746692 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.746876 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.747011 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.747183 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.747315 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.747491 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.747625 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.747793 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.747936 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.748079 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.748225 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.748386 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.748530 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.748696 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.748829 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.749004 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.749148 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.749313 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.749455 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.749619 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.749750 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.749925 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.750067 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.750273 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.750420 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.750586 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.750725 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.750887 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.751027 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.751190 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.751319 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.751490 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.751621 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.751799 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.751930 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.752103 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.752243 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.752401 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.752530 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.752705 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.752846 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.753009 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.753140 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.753311 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.753401 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.753607 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.753758 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.753892 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.754031 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.754250 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.754398 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.754533 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.754677 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.754829 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.754961 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.755101 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.755239 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.755402 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.755547 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.755703 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.755855 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.756007 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.756145 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.756311 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.756457 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.756611 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.756766 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.756913 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.757068 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.757213 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.757378 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.757527 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.757686 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.757828 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.757997 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.758205 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.758871 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.759075 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.759230 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.759455 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.759543 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.759777 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.759867 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.760084 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.760181 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.760408 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.760499 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.760717 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.760815 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.761021 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.761119 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.761321 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.761409 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.761625 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.761715 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.761926 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.762024 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.762256 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.762357 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.762564 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.762652 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.762881 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.762980 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.763186 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.763275 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.763485 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.763604 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.763787 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.763889 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.764086 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.764172 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.764393 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.764560 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.764698 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.764871 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.765024 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.765182 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.765337 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.765487 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.765644 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.765790 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.765952 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.766089 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.766287 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.766416 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.766596 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.766719 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.766892 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.767038 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.767203 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.767344 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.767528 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.767645 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.767845 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.767941 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.768152 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.768239 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.768463 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.768565 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.768768 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.768863 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.769073 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.769199 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.769377 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.769502 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.769686 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.769815 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.769994 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.770149 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.770318 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.770451 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.770613 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.770761 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.770918 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.771072 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.771224 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.771374 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.771545 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.771686 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.771853 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.771995 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.772156 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.772304 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.772459 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.772609 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.772761 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.772911 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.773105 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.773229 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.773412 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.773534 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.773809 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.773987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.774119 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.774341 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.774463 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.774661 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.774808 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.774985 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.775074 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.775311 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.775475 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.775604 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.775701 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.775921 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.776099 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.776257 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.776412 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.776567 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.776731 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.776889 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.777037 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.777182 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.777322 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.777480 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.777631 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.777778 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.777918 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.778072 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.778253 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.778415 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.778555 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.778692 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.778828 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.778965 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.779113 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.779261 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.779395 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.779533 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.779672 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.779812 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.779907 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.780071 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.780162 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.780372 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.780461 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.780679 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.780779 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.780983 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.781071 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.781289 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.781376 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.781593 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.781691 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.781960 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.782197 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.782349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.782504 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.782647 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.782801 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.782943 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.783085 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.783222 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.783858 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.784001 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.784161 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.784305 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.784462 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.784605 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.784747 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.784916 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.785057 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.785199 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.785366 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.785496 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.785618 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.785758 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.785885 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.786013 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.786150 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.786625 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.786769 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.786932 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.787077 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.787224 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.787364 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.787509 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.787665 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.787821 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.787987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.788134 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.788279 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.788422 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.788574 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.788722 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.788855 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.788997 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.789128 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.789258 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.790337 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.790461 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.790579 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.790694 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.790812 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.790930 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.791075 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.791224 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.791375 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.791510 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.791648 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.791797 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.791948 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.792089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.792237 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.792392 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.792525 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.792678 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.792820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.792960 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.793099 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.793235 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.793376 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.793531 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.793683 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.793821 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.793952 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.794152 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.794334 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.794485 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.794485 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.794726 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.794859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.800729 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.800729 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.801150 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.801281 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.801408 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.801526 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.801666 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.801809 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.801948 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.802088 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.802379 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.802379 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.802648 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.802791 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.802949 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.803110 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.803251 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.803393 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.803540 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.803682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.803824 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.803979 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.804124 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.804330 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.804492 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.804492 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.804738 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.804896 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.805883 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.806034 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.806192 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.806335 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.806476 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.806622 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.806757 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.810033 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.810234 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.810406 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.810570 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.810723 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.810870 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.811015 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.811163 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.811307 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.811469 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.811616 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.811762 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.811762 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812027 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812185 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812185 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812461 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812596 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812729 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812868 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.812868 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.813148 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.813288 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.813421 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.813556 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.813695 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.813856 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.813995 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.814135 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.814358 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.814554 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.814705 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.814865 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.814865 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.815134 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.815278 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.815426 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.815572 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.815791 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.815999 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.816148 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.816294 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.816436 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.816638 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.816638 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.816928 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.817072 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.817232 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.817374 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.817532 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.817685 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.817852 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.817997 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.818143 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.818390 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.818556 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.818700 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.818857 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.818999 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.818999 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.819249 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.819404 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.819404 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.819647 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.819784 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.819784 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.820042 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.820195 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.820195 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.820469 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.820640 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.820784 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.820940 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.821138 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.821296 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.821443 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.821586 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.821729 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.821888 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.822021 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.822155 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.822393 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.822560 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.822733 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.823022 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.823199 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.823389 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.823571 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.823722 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.823875 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.824032 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.824175 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.824317 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.824457 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.824664 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.824664 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.824952 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.825085 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.825232 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.825362 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.825362 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.825633 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.825779 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.825779 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.826125 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.826352 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.826352 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.826656 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.826802 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.826945 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.827091 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.827235 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.827376 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.827536 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.827681 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.827835 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.827986 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.828120 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.828270 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.828406 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.828549 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.828681 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.828809 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.828942 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.829098 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.829249 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.829404 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.829566 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.829720 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.829874 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.829874 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.830326 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.830472 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.830472 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.830735 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.830879 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831035 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831180 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831315 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831315 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831562 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831714 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831849 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.831849 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.832102 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.832229 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.832380 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.832534 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.832690 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.832834 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.832981 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.833125 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.833266 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.833423 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.833564 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.833703 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.833851 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.833991 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.834165 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.834399 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.834532 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.834663 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.834808 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.834965 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.835124 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.835267 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.835415 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.835567 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.835714 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.835857 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.836015 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.836406 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.836570 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.836714 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.836912 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.837076 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.837215 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.837350 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.837505 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.837642 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.837775 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.837920 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.838060 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.838272 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.838415 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.838559 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.838722 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.838877 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.839032 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.839177 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.839319 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.839463 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.839622 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.839827 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.839972 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.840125 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.840272 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.840419 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.840579 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.840731 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.840870 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841004 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841147 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841293 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841413 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841553 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841688 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841819 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.841951 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.842153 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.842326 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.842459 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.842586 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.842714 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.842862 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.843013 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.843149 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.843149 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.843420 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.843420 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.843708 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.843869 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844011 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844152 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844301 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844436 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844594 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844732 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844866 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.844997 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.845124 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.845272 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.845429 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.845576 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.845720 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.845863 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.846009 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.846155 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.846370 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.846517 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.846665 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.846807 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.847022 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.847181 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.847331 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.847477 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.847619 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.847775 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.847909 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.848058 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.848193 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.848338 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.848481 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.848611 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.848743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.848893 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.849036 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.849178 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.849323 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.849467 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.849610 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.849765 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.849910 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.850058 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.850228 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.850400 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.850556 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.850702 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.850847 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.850990 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.851135 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.851289 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.851495 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.851634 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.851769 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.852419 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.852559 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.852707 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.852864 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853002 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853124 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853257 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853391 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853523 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853672 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853800 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.853800 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.854048 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.854271 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.854435 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.854435 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.854723 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.854723 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.855045 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.855193 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.855345 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.855480 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.855616 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.855762 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.855897 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.856030 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.856172 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.856316 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.856458 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.856613 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.856756 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.856900 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.857056 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.857217 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.857361 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.857507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.857662 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.857662 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.858054 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.858223 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.858371 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.858515 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.858686 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.858838 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.858972 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.859108 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.859244 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.859378 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.859513 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.859655 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.859788 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.859927 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.860066 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.860207 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.860344 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.860506 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.860645 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.860784 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.860922 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.861062 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.861217 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.861358 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.861493 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.861635 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.861781 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.861919 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.862067 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.862225 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.862380 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.862518 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.862656 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.862801 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.862951 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.863086 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.863233 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.863621 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.863762 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.863910 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.864062 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.864209 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.864360 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.864512 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.864656 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.864808 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.864946 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.865145 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.865282 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.865417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.865560 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.865709 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.865854 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.865995 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.866138 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.866358 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.866519 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.866519 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.866811 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.866811 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.867092 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.867236 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.867492 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.868129 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.868275 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.868422 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.868567 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.868712 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.868879 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869019 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869153 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869285 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869433 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869574 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869733 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869867 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.869996 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.870133 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.870314 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.870477 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.870623 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.870765 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.870911 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.871051 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.871193 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.871352 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.871509 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.871653 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.871783 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.871925 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.872063 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.872210 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.872342 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.872342 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.872591 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.872724 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.872856 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.873004 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.873138 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.873281 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.873411 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.873563 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.873713 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.873865 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.874010 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.874209 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.874356 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.874499 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.874660 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.874799 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.874932 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.875080 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.875275 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.875413 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.875613 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.875755 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.875897 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.876056 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.876202 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.876357 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.876518 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.876674 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.876821 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.876965 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.877112 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.877271 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.877420 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.877565 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.877711 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.877855 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.878001 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.878157 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.878320 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.878454 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.878592 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.878724 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.878876 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.879010 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.879138 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.879289 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.879430 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.879585 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.879743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.879898 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.880043 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.880185 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.880330 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.880473 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.880629 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.880786 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.880933 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.881085 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.881225 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.881356 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.881508 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.881657 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.881845 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.881985 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.882128 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.882304 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.882446 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.882583 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.882729 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.882868 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.883012 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.883198 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.883340 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.883495 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.883812 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.883954 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.884087 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.884251 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.884387 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.884521 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.884654 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.884784 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.884916 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.885079 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.885079 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.885363 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.885507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.885672 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.885672 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.886057 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.886286 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.886435 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.886598 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.886745 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.886902 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.887051 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.887206 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.887349 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.887488 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.887620 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.887769 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.887909 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.888052 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.888188 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.888317 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.888459 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.888595 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.888748 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.888894 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.889038 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.889192 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.889348 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.889502 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.889647 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.889791 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.889944 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.890099 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.890287 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.890287 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.890542 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.890734 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.890874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891009 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891153 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891298 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891429 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891560 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891686 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891836 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891974 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.891974 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.892235 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.892235 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.892498 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.892654 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.892797 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.892952 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.893092 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.893228 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.893377 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.893526 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.893671 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.893807 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.893935 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.894065 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.894250 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.894397 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.894552 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.894696 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.894853 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.894998 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.895249 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.895393 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.895537 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.895691 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.895837 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.895994 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.896155 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.896300 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.896462 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.896603 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.896748 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.896902 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.897041 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.897173 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.897305 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.897435 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.897631 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.897792 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.897933 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.898077 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.898313 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.898532 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.898710 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.898873 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899016 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899158 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899302 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899446 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899603 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899761 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:46:45.899894 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899894 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899894 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899894 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:46:45.899894 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:46:45.959837 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO dbcounter [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Registered counter for database nova_api Jun 15 14:46:45.962676 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO dbcounter [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Registered counter for database nova_api Jun 15 14:46:45.982442 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:45.985784 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:45.989638 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writer thread running {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:45.992892 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writer thread running {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:46.048729 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.context [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bbffb719-9963-4c10-ac0c-7cdf90539028(cell1) {{(pid=110273) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:46:46.050558 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.context [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bbffb719-9963-4c10-ac0c-7cdf90539028(cell1) {{(pid=110272) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:46:46.053029 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.054689 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_concurrency.lockutils [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.054822 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.055619 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.056349 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_concurrency.lockutils [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.057159 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_concurrency.lockutils [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:46:46.057647 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.059215 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_concurrency.lockutils [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:46:46.059700 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO dbcounter [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Registered counter for database nova_cell0 Jun 15 14:46:46.061219 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO dbcounter [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Registered counter for database nova_cell0 Jun 15 14:46:46.063672 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO dbcounter [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Registered counter for database nova_cell1 Jun 15 14:46:46.065089 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO dbcounter [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Registered counter for database nova_cell1 Jun 15 14:46:46.072120 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:46.075186 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:46.076050 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:46.077285 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:46.083548 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writer thread running {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:46.083673 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writer thread running {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:46.083897 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writer thread running {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:46.083987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writer thread running {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:46.233499 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO dbcounter [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Registered counter for database nova_cell0 Jun 15 14:46:46.235457 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO dbcounter [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Registered counter for database nova_cell0 Jun 15 14:46:46.243989 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:46.245930 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:46:46.248961 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writer thread running {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:46.250717 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writer thread running {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:46:46.704779 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: WARNING keystonemiddleware.auth_token [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:46:46.712633 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: WARNING keystonemiddleware.auth_token [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:46:46.854319 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: WARNING keystonemiddleware.auth_token [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:46:46.861870 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: WARNING keystonemiddleware.auth_token [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:46:47.056919 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: WARNING keystonemiddleware.auth_token [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:46:47.063130 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: WARNING keystonemiddleware.auth_token [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:46:47.068614 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4a82379c0 pid: 110273 (default app) Jun 15 14:46:47.071562 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:46:47.072805 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002635 Jun 15 14:46:47.073244 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Wed Jun 15 14:46:47 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:46:47.212989 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: WARNING keystonemiddleware.auth_token [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:46:47.218558 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: WARNING keystonemiddleware.auth_token [None req-1ce5a5a6-5cf2-44db-8ae9-260337e1cf0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:46:47.223841 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4a82379c0 pid: 110272 (default app) Jun 15 14:48:10.030100 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:10.031149 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 15 14:48:10.031552 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:10.047724 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writing DB stats nova_api:SELECT=3 {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:10.048840 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writing DB stats nova_cell0:SELECT=3 {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:10.049672 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writing DB stats nova_cell1:SELECT=3 {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:10.050534 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:10.480013 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-220a2a5e-a7d2-4a90-a0bd-7e5c6aba215a admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:10.510367 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-220a2a5e-a7d2-4a90-a0bd-7e5c6aba215a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.471579 Jun 15 14:48:10.510933 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Jun 15 14:48:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:12.759084 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:12.761282 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-3cd68937-ff4f-42eb-8a6f-5846fc2d605b None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002608 Jun 15 14:48:12.765891 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:12 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:12.831571 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-8227becd-b4c9-4293-9ceb-e213d5593861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:12.852089 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:12.852089 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: warnings.warn(msg) Jun 15 14:48:12.965694 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-8227becd-b4c9-4293-9ceb-e213d5593861 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.197863 Jun 15 14:48:12.966383 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:12.979974 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_api:SELECT=3 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:12.980929 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_cell1:SELECT=3 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:12.982408 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_cell0:SELECT=3 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:12.983180 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:48:13.190054 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-f5e7f7ff-b313-4eed-8faf-4fc47abe3485 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:13.192474 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:13.192474 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: warnings.warn(msg) Jun 15 14:48:13.334544 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-f5e7f7ff-b313-4eed-8faf-4fc47abe3485 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360078 Jun 15 14:48:13.341950 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Jun 15 14:48:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:15.550912 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-8227becd-b4c9-4293-9ceb-e213d5593861 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:15.551946 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-8227becd-b4c9-4293-9ceb-e213d5593861 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 15 14:48:15.552607 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:15.663097 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-56c27dd2-a638-4aca-b1ae-24d54313a9b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "ram": 512, "vcpus": 1}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:15.682103 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:15.682103 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: warnings.warn(msg) Jun 15 14:48:15.791981 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-56c27dd2-a638-4aca-b1ae-24d54313a9b8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.232394 Jun 15 14:48:15.792686 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:15.804869 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-cd174d5d-0af1-4986-94cb-6949fc6fd8f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:15.807529 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:48:15.807529 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: warnings.warn(msg) Jun 15 14:48:15.921299 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-cd174d5d-0af1-4986-94cb-6949fc6fd8f2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120242 Jun 15 14:48:15.922666 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Jun 15 14:48:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:18.148068 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-56c27dd2-a638-4aca-b1ae-24d54313a9b8 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:18.149101 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-56c27dd2-a638-4aca-b1ae-24d54313a9b8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 15 14:48:18.149682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:18.213930 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-4e2500d8-2d89-4e42-9547-6d2446f1f5f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:18.320542 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-4e2500d8-2d89-4e42-9547-6d2446f1f5f4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164723 Jun 15 14:48:18.321335 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:48:18.333308 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-a8d91a2e-3ae2-48da-83e3-d7ce14898338 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:18.426961 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-a8d91a2e-3ae2-48da-83e3-d7ce14898338 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097339 Jun 15 14:48:18.427809 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Jun 15 14:48:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:20.672492 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-4e2500d8-2d89-4e42-9547-6d2446f1f5f4 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:20.673514 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-4e2500d8-2d89-4e42-9547-6d2446f1f5f4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 15 14:48:20.673917 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:20.734404 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-615fc491-8459-4181-a8da-cda210635b5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3"}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:20.806127 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-615fc491-8459-4181-a8da-cda210635b5a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126286 Jun 15 14:48:20.807344 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:48:20.819820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-5289908e-7739-4dee-af3d-773fe4e7229a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:20.933104 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-5289908e-7739-4dee-af3d-773fe4e7229a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116587 Jun 15 14:48:20.933671 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Jun 15 14:48:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:23.146466 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-615fc491-8459-4181-a8da-cda210635b5a admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:23.147474 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-615fc491-8459-4181-a8da-cda210635b5a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 15 14:48:23.152831 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:23.210128 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-ef72afb5-890d-4d97-a2e5-32651bc86fbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:23.326377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-ef72afb5-890d-4d97-a2e5-32651bc86fbb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.171871 Jun 15 14:48:23.327175 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:48:23.339636 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-984c48d6-ab9b-409d-8595-65c9aa2be1a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:23.444189 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-984c48d6-ab9b-409d-8595-65c9aa2be1a0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108931 Jun 15 14:48:23.454985 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Wed Jun 15 14:48:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:25.644750 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-ef72afb5-890d-4d97-a2e5-32651bc86fbb admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:25.645756 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-ef72afb5-890d-4d97-a2e5-32651bc86fbb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 15 14:48:25.646362 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:25.709867 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-c03b371d-291f-45bd-871e-ac594ba08775 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:25.734334 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-c03b371d-291f-45bd-871e-ac594ba08775 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081196 Jun 15 14:48:25.734891 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Jun 15 14:48:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:48:27.984804 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-ef72afb5-890d-4d97-a2e5-32651bc86fbb admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:27.985881 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-ef72afb5-890d-4d97-a2e5-32651bc86fbb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 15 14:48:27.986157 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:28.050820 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-584d517e-06bd-487f-9ca5-475fb6827c0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "1", "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:28.158407 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-584d517e-06bd-487f-9ca5-475fb6827c0b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.166295 Jun 15 14:48:28.158962 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:28.170960 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-7cc04cb5-dfe8-45b1-80c7-4abe675abbe3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:28.282739 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-7cc04cb5-dfe8-45b1-80c7-4abe675abbe3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115397 Jun 15 14:48:28.284033 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Jun 15 14:48:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:48:30.515432 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-584d517e-06bd-487f-9ca5-475fb6827c0b admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:30.516479 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-584d517e-06bd-487f-9ca5-475fb6827c0b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 15 14:48:30.516938 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:48:30.580065 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-571f8b66-5426-46e4-8134-2c03bb4f3153 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "disk": 20}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:30.723097 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-571f8b66-5426-46e4-8134-2c03bb4f3153 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.197753 Jun 15 14:48:30.723579 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:48:30.736236 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-4e8cdf0a-2d74-4cb9-9576-5106b64fdbbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:30.823263 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-4e8cdf0a-2d74-4cb9-9576-5106b64fdbbc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090718 Jun 15 14:48:30.823849 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Jun 15 14:48:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:33.135181 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-571f8b66-5426-46e4-8134-2c03bb4f3153 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:33.136296 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-571f8b66-5426-46e4-8134-2c03bb4f3153 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Jun 15 14:48:33.136700 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:33.194018 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-3c5b5de3-1632-4203-9682-5ebf88a8b5e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:33.294304 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-3c5b5de3-1632-4203-9682-5ebf88a8b5e7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.151574 Jun 15 14:48:33.294786 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:48:33.306959 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-845c66f1-0234-4e33-8066-41f050995674 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:33.402747 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-845c66f1-0234-4e33-8066-41f050995674 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099669 Jun 15 14:48:33.403345 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Jun 15 14:48:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) Jun 15 14:48:35.639618 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-3c5b5de3-1632-4203-9682-5ebf88a8b5e7 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:35.640548 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-3c5b5de3-1632-4203-9682-5ebf88a8b5e7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 15 14:48:35.641008 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:35.702362 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-681ae132-99b2-4094-b093-40b89d478e2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "id": "4"}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:35.840656 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-681ae132-99b2-4094-b093-40b89d478e2c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.185332 Jun 15 14:48:35.840656 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:48:35.844826 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-b7499da6-35d7-40cb-8786-72d96bc50e8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:35.938351 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-b7499da6-35d7-40cb-8786-72d96bc50e8b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097115 Jun 15 14:48:35.939192 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Jun 15 14:48:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:48:38.158532 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-681ae132-99b2-4094-b093-40b89d478e2c admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:48:38.160287 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-681ae132-99b2-4094-b093-40b89d478e2c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Jun 15 14:48:38.160697 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:48:38.227405 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-c30b539a-d87a-4aae-8869-dcf73aa3a44a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "name": "m1.xlarge"}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:38.306564 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-c30b539a-d87a-4aae-8869-dcf73aa3a44a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.139388 Jun 15 14:48:38.308839 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Wed Jun 15 14:48:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:48:38.320682 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-862fe72c-79ec-40f3-99e1-32d204f9bb4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:48:38.407232 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-862fe72c-79ec-40f3-99e1-32d204f9bb4f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090172 Jun 15 14:48:38.408160 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Wed Jun 15 14:48:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:49:02.957993 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-c30b539a-d87a-4aae-8869-dcf73aa3a44a admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:02.959035 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-c30b539a-d87a-4aae-8869-dcf73aa3a44a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 15 14:49:02.959432 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:02.970259 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:03.023685 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-08c2167b-73c4-4153-a0c2-346eaf4e2ddc admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:03.040859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-08c2167b-73c4-4153-a0c2-346eaf4e2ddc admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075227 Jun 15 14:49:03.041390 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Jun 15 14:49:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:04.006615 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-c30b539a-d87a-4aae-8869-dcf73aa3a44a admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:04.007625 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-c30b539a-d87a-4aae-8869-dcf73aa3a44a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 15 14:49:04.008059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:04.215327 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-79dd1265-2b37-40eb-8719-f3ba52fff836 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:04.221146 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.wsgi [None req-79dd1265-2b37-40eb-8719-f3ba52fff836 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-79dd1265-2b37-40eb-8719-f3ba52fff836 admin admin] Request method failure captured: Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Accept: application/json Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Accept-Encoding: gzip, deflate Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Connection: keep-alive Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Content-Length: 0 Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Host: 10.222.0.23 Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Openstack-Api-Version: compute 2.90 Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Openstack-System-Scope: None Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: User-Agent: python-novaclient Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Auth-Token: gAAAAABiqfFf4J1ewKheZiaXQiuby0TPe0Ny_aI_5AMYiVLB5MBvRlU5Jfj1soHyL3x3K6palKUxLjwRwIt4a-ubBHV3EhpD6pChVf8M8wAZAyBGE_sDAaZstjysoByG6MG9B1uP0uVF73TKlIFRWCki68CVWyey4Yh06CvP3DIgbNYkX5BaXBI Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Domain-Id: None Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Domain-Name: None Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Identity-Status: Confirmed Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Is-Admin-Project: True Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Domain-Id: default Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Domain-Name: Default Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Name: admin Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Role: reader,admin,member Jun 15 14:49:04.224987 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Roles: reader,admin,member Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_108eb4dc74a441578e74c932122b6873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/108eb4dc74a441578e74c932122b6873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant: admin Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant-Name: admin Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User: admin Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Domain-Id: default Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Domain-Name: Default Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Id: 68464924e2e845d8a0fc9fa4fd5b1824 Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Name: admin Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: method: > Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: exception: Flavor 42 could not be found. Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: action_args: {'id': '42'} Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:04.226646 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:04.227507 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.228820 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-79dd1265-2b37-40eb-8719-f3ba52fff836 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:04.230324 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-79dd1265-2b37-40eb-8719-f3ba52fff836 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068451 Jun 15 14:49:04.230324 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Jun 15 14:49:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:49:04.236499 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-772c8610-09b0-4e6b-83df-8e07a473751f admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:04.239458 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:49:04.258729 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-772c8610-09b0-4e6b-83df-8e07a473751f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025764 Jun 15 14:49:04.259268 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Jun 15 14:49:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:04.269941 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-2ac25849-e633-47e8-8ed0-1b4344aec677 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:04.291436 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-2ac25849-e633-47e8-8ed0-1b4344aec677 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025464 Jun 15 14:49:04.292573 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Jun 15 14:49:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:49:04.302232 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-af6398d1-e088-418b-9c0f-b17fb5c5dae8 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:04.308774 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.wsgi [None req-af6398d1-e088-418b-9c0f-b17fb5c5dae8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-af6398d1-e088-418b-9c0f-b17fb5c5dae8 admin admin] Request method failure captured: Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Accept: application/json Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Accept-Encoding: gzip, deflate Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Connection: keep-alive Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Content-Length: 0 Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Host: 10.222.0.23 Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Openstack-Api-Version: compute 2.90 Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Openstack-System-Scope: None Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: User-Agent: python-novaclient Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Auth-Token: gAAAAABiqfFf4J1ewKheZiaXQiuby0TPe0Ny_aI_5AMYiVLB5MBvRlU5Jfj1soHyL3x3K6palKUxLjwRwIt4a-ubBHV3EhpD6pChVf8M8wAZAyBGE_sDAaZstjysoByG6MG9B1uP0uVF73TKlIFRWCki68CVWyey4Yh06CvP3DIgbNYkX5BaXBI Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Domain-Id: None Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Domain-Name: None Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Identity-Status: Confirmed Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Is-Admin-Project: True Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Domain-Id: default Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Domain-Name: Default Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Name: admin Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Role: reader,admin,member Jun 15 14:49:04.312050 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Roles: reader,admin,member Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_108eb4dc74a441578e74c932122b6873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/108eb4dc74a441578e74c932122b6873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant: admin Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant-Name: admin Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User: admin Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Domain-Id: default Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Domain-Name: Default Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Id: 68464924e2e845d8a0fc9fa4fd5b1824 Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Name: admin Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: method: > Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: exception: Flavor 42 could not be found. Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: action_args: {'id': '42'} Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:04.326874 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:04.327682 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:04.328716 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-af6398d1-e088-418b-9c0f-b17fb5c5dae8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:04.329785 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-af6398d1-e088-418b-9c0f-b17fb5c5dae8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015276 Jun 15 14:49:04.329785 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Jun 15 14:49:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 14:49:05.176203 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-2ac25849-e633-47e8-8ed0-1b4344aec677 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:05.177205 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-2ac25849-e633-47e8-8ed0-1b4344aec677 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 15 14:49:05.177590 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:05.375277 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-5d8b6262-9d5e-4c80-9be7-b9d662cfe61e admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:05.382910 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.wsgi [None req-5d8b6262-9d5e-4c80-9be7-b9d662cfe61e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-5d8b6262-9d5e-4c80-9be7-b9d662cfe61e admin admin] Request method failure captured: Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Accept: application/json Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Accept-Encoding: gzip, deflate Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Connection: keep-alive Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Content-Length: 0 Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Host: 10.222.0.23 Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Openstack-Api-Version: compute 2.90 Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Openstack-System-Scope: None Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: User-Agent: python-novaclient Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Auth-Token: gAAAAABiqfFhD7vFYwrE2vavC2PlY52Qf-t_1NpNNopi8W3aD5BUisFvMjNWQM8fBrkngdx3_7q-I5Ti9N5QzY_tmuuOOf-iZNK6NMBDXzhU56Uig1oIa-l8VGkWzXDeMxgXiCXxge9xxg_McpMRqIJ0SMPXj4b1iN0jZb_gX6j51rsyNzcwPE0 Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Domain-Id: None Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Domain-Name: None Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Identity-Status: Confirmed Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Is-Admin-Project: True Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Domain-Id: default Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Domain-Name: Default Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Name: admin Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Role: reader,admin,member Jun 15 14:49:05.385425 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Roles: reader,admin,member Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_108eb4dc74a441578e74c932122b6873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/108eb4dc74a441578e74c932122b6873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant: admin Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant-Name: admin Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User: admin Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Domain-Id: default Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Domain-Name: Default Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Id: 68464924e2e845d8a0fc9fa4fd5b1824 Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Name: admin Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: method: > Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: exception: Flavor 84 could not be found. Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: action_args: {'id': '84'} Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:05.387089 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:05.388059 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.389417 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-5d8b6262-9d5e-4c80-9be7-b9d662cfe61e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:05.390704 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-5d8b6262-9d5e-4c80-9be7-b9d662cfe61e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066009 Jun 15 14:49:05.390704 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Jun 15 14:49:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:49:05.397180 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3ce77dc4-c45b-49e8-9af3-70a2f60fc637 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:05.413438 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3ce77dc4-c45b-49e8-9af3-70a2f60fc637 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019740 Jun 15 14:49:05.413988 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Jun 15 14:49:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:05.426750 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-72ab34cd-7bee-419e-8d29-995357f36599 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:05.441914 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-72ab34cd-7bee-419e-8d29-995357f36599 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019478 Jun 15 14:49:05.442479 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Jun 15 14:49:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:05.451752 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-638507d7-a4c2-4530-a965-22d34e972f65 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:05.457276 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.wsgi [None req-638507d7-a4c2-4530-a965-22d34e972f65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-638507d7-a4c2-4530-a965-22d34e972f65 admin admin] Request method failure captured: Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Accept: application/json Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Accept-Encoding: gzip, deflate Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Connection: keep-alive Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Content-Length: 0 Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Host: 10.222.0.23 Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Openstack-Api-Version: compute 2.90 Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Openstack-System-Scope: None Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: User-Agent: python-novaclient Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Auth-Token: gAAAAABiqfFhD7vFYwrE2vavC2PlY52Qf-t_1NpNNopi8W3aD5BUisFvMjNWQM8fBrkngdx3_7q-I5Ti9N5QzY_tmuuOOf-iZNK6NMBDXzhU56Uig1oIa-l8VGkWzXDeMxgXiCXxge9xxg_McpMRqIJ0SMPXj4b1iN0jZb_gX6j51rsyNzcwPE0 Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Domain-Id: None Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Domain-Name: None Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Identity-Status: Confirmed Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Is-Admin-Project: True Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Domain-Id: default Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Domain-Name: Default Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Name: admin Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Role: reader,admin,member Jun 15 14:49:05.458860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Roles: reader,admin,member Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_108eb4dc74a441578e74c932122b6873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/108eb4dc74a441578e74c932122b6873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant: admin Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant-Name: admin Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User: admin Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Domain-Id: default Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Domain-Name: Default Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Id: 68464924e2e845d8a0fc9fa4fd5b1824 Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Name: admin Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: method: > Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: exception: Flavor 84 could not be found. Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: action_args: {'id': '84'} Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:05.460377 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:05.461404 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:05.462859 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-638507d7-a4c2-4530-a965-22d34e972f65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:05.464286 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-638507d7-a4c2-4530-a965-22d34e972f65 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012028 Jun 15 14:49:05.464286 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Jun 15 14:49:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:49:06.332514 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-72ab34cd-7bee-419e-8d29-995357f36599 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:06.333518 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-72ab34cd-7bee-419e-8d29-995357f36599 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 15 14:49:06.333915 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:06.525448 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-68081e7a-d084-4aa2-8f76-b450dfeeaae0 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:06.531984 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.wsgi [None req-68081e7a-d084-4aa2-8f76-b450dfeeaae0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-68081e7a-d084-4aa2-8f76-b450dfeeaae0 admin admin] Request method failure captured: Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Accept: application/json Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Accept-Encoding: gzip, deflate Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Connection: keep-alive Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Content-Length: 0 Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Host: 10.222.0.23 Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Openstack-Api-Version: compute 2.90 Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Openstack-System-Scope: None Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: User-Agent: python-novaclient Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Auth-Token: gAAAAABiqfFiLAG6s2D2wJhGAOnIaSSGGFedddMIge6Fw-N1lQ65CI5eIfZzOuzcdDoTrsDjpJyrm_GOXuYAKEetcWIdrvOdnRnawgmifmLmgG4mShFQkhChWKK0Jqf4Y00X8BCj3XmTEWllwQ5L606id_km0E_tmbpZTmlAoCHkjUVnP7QreMg Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Domain-Id: None Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Domain-Name: None Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Identity-Status: Confirmed Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Is-Admin-Project: True Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Domain-Id: default Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Domain-Name: Default Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Project-Name: admin Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Role: reader,admin,member Jun 15 14:49:06.533265 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Roles: reader,admin,member Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_108eb4dc74a441578e74c932122b6873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/108eb4dc74a441578e74c932122b6873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant: admin Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-Tenant-Name: admin Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User: admin Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Domain-Id: default Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Domain-Name: Default Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Id: 68464924e2e845d8a0fc9fa4fd5b1824 Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: X-User-Name: admin Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: method: > Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: exception: Flavor 451 could not be found. Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: action_args: {'id': '451'} Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:06.534798 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:06.535860 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.537255 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-68081e7a-d084-4aa2-8f76-b450dfeeaae0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:06.538656 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-68081e7a-d084-4aa2-8f76-b450dfeeaae0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061538 Jun 15 14:49:06.538656 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Jun 15 14:49:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:49:06.544349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-c43b90fb-8520-42f1-83a4-9364a8010bb2 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:06.558587 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-c43b90fb-8520-42f1-83a4-9364a8010bb2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017790 Jun 15 14:49:06.559139 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Jun 15 14:49:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:06.568634 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:06.583250 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018215 Jun 15 14:49:06.583788 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Jun 15 14:49:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:49:06.599379 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-d23e2363-4949-4ea7-b11a-baadbc331d8d admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:06.604800 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.wsgi [None req-d23e2363-4949-4ea7-b11a-baadbc331d8d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-d23e2363-4949-4ea7-b11a-baadbc331d8d admin admin] Request method failure captured: Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Accept: application/json Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Accept-Encoding: gzip, deflate Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Connection: keep-alive Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Content-Length: 0 Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Host: 10.222.0.23 Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Openstack-Api-Version: compute 2.90 Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Openstack-System-Scope: None Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: User-Agent: python-novaclient Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Auth-Token: gAAAAABiqfFiLAG6s2D2wJhGAOnIaSSGGFedddMIge6Fw-N1lQ65CI5eIfZzOuzcdDoTrsDjpJyrm_GOXuYAKEetcWIdrvOdnRnawgmifmLmgG4mShFQkhChWKK0Jqf4Y00X8BCj3XmTEWllwQ5L606id_km0E_tmbpZTmlAoCHkjUVnP7QreMg Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Domain-Id: None Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Domain-Name: None Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Identity-Status: Confirmed Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Is-Admin-Project: True Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Domain-Id: default Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Domain-Name: Default Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Project-Name: admin Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Role: reader,admin,member Jun 15 14:49:06.606349 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Roles: reader,admin,member Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/108eb4dc74a441578e74c932122b6873"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_108eb4dc74a441578e74c932122b6873"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/108eb4dc74a441578e74c932122b6873"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant: admin Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant-Id: 108eb4dc74a441578e74c932122b6873 Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-Tenant-Name: admin Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User: admin Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Domain-Id: default Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Domain-Name: Default Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Id: 68464924e2e845d8a0fc9fa4fd5b1824 Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: X-User-Name: admin Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: method: > Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: exception: Flavor 451 could not be found. Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: action_args: {'id': '451'} Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:49:06.607743 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:06.613511 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: ERROR nova.api.openstack.wsgi Jun 15 14:49:06.614859 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-d23e2363-4949-4ea7-b11a-baadbc331d8d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:49:06.616095 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-d23e2363-4949-4ea7-b11a-baadbc331d8d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011999 Jun 15 14:49:06.616095 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Jun 15 14:49:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 14:49:07.484239 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:07.485251 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 15 14:49:07.485641 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:07.678060 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-21c94709-9451-4b32-8522-9f61f19690fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:07.755604 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-21c94709-9451-4b32-8522-9f61f19690fc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.129327 Jun 15 14:49:07.756075 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Jun 15 14:49:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:49:08.635304 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:08.637024 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Jun 15 14:49:08.637388 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:08.831302 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-078c4a00-bb54-44cf-afc4-9e4a0bc55107 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:08.924357 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-078c4a00-bb54-44cf-afc4-9e4a0bc55107 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.145870 Jun 15 14:49:08.924848 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Jun 15 14:49:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:49:09.792369 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:09.793433 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Jun 15 14:49:09.793827 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:09.982299 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-a48bd84c-f20c-4f16-bf14-af03209ab396 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:10.061311 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-a48bd84c-f20c-4f16-bf14-af03209ab396 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.129693 Jun 15 14:49:10.061781 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Jun 15 14:49:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:49:10.940555 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:10.941577 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 15 14:49:10.941969 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:11.137091 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-6697f656-46c4-44a2-8918-999e51f39c20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:49:11.221749 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-6697f656-46c4-44a2-8918-999e51f39c20 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.138454 Jun 15 14:49:11.222319 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Jun 15 14:49:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:49:12.127123 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:12.128134 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 15 14:49:12.128532 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:49:12.319987 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-a58dc243-9a40-4f7c-9ad9-75e740363284 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:49:12.340388 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-a58dc243-9a40-4f7c-9ad9-75e740363284 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074640 Jun 15 14:49:12.340860 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Wed Jun 15 14:49:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:01.397296 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.398348 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-3b8d2007-56b3-41fb-abb5-ef5d3174a538 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 15 14:50:01.398744 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:50:01.409471 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:01.456494 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-c93f5fbe-a61d-4fd3-8726-44370167097b admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.476380 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-c93f5fbe-a61d-4fd3-8726-44370167097b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071345 Jun 15 14:50:01.476906 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:50:01.500188 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-653f97a0-5b78-44f3-b49b-f3db0cac2c01 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.503882 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG dbcounter [-] [110272] Writing DB stats nova_api:SELECT=14 {{(pid=110272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:50:01.508851 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-653f97a0-5b78-44f3-b49b-f3db0cac2c01 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012308 Jun 15 14:50:01.509367 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:01.521836 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-a137099d-db62-40e6-98fd-bb4f27bf9f51 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.531042 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-a137099d-db62-40e6-98fd-bb4f27bf9f51 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013123 Jun 15 14:50:01.531595 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:01.544183 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.552315 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012669 Jun 15 14:50:01.552848 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:50:01.564361 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-166e5575-0a74-4441-8909-b0599e1b57a7 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:50:01.572154 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-166e5575-0a74-4441-8909-b0599e1b57a7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011413 Jun 15 14:50:01.573170 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Wed Jun 15 14:50:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:53:31.824110 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:31.825116 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 15 14:53:31.825510 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:31.982604 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_api:SELECT=6 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:32.095633 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-9152adc0-0dff-44c4-98ef-5de2b700a8d6 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:32.096821 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:32.096821 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: warnings.warn(msg) Jun 15 14:53:32.098002 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-9152adc0-0dff-44c4-98ef-5de2b700a8d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:32.098457 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-9152adc0-0dff-44c4-98ef-5de2b700a8d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:32.099225 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-9152adc0-0dff-44c4-98ef-5de2b700a8d6 admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:32.099642 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-9152adc0-0dff-44c4-98ef-5de2b700a8d6 admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:32.133554 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-9152adc0-0dff-44c4-98ef-5de2b700a8d6 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152410 Jun 15 14:53:32.134100 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Jun 15 14:53:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:53:33.019658 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:33.020671 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 15 14:53:33.021230 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:53:33.213064 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-e5a17af7-9fcb-4389-90de-a3521f0159a4 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:33.214301 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:33.214301 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: warnings.warn(msg) Jun 15 14:53:33.215502 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-e5a17af7-9fcb-4389-90de-a3521f0159a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:33.215940 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-e5a17af7-9fcb-4389-90de-a3521f0159a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:33.216713 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-e5a17af7-9fcb-4389-90de-a3521f0159a4 admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:33.217136 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-e5a17af7-9fcb-4389-90de-a3521f0159a4 admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:33.237516 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-e5a17af7-9fcb-4389-90de-a3521f0159a4 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076699 Jun 15 14:53:33.238000 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Jun 15 14:53:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:53:44.634207 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:44.635230 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 15 14:53:44.635630 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:44.781829 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_cell0:SELECT=4 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:44.782398 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_cell1:SELECT=4 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:44.782966 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG dbcounter [-] [110273] Writing DB stats nova_api:SELECT=8 {{(pid=110273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:53:44.832785 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-f1234be0-1e06-4c80-a78b-37db09bb0af9 admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:44.833972 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:44.833972 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: warnings.warn(msg) Jun 15 14:53:44.835184 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-f1234be0-1e06-4c80-a78b-37db09bb0af9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:44.838641 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-f1234be0-1e06-4c80-a78b-37db09bb0af9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:44.838641 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-f1234be0-1e06-4c80-a78b-37db09bb0af9 admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:44.838641 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-f1234be0-1e06-4c80-a78b-37db09bb0af9 admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:44.863274 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-f1234be0-1e06-4c80-a78b-37db09bb0af9 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086623 Jun 15 14:53:44.863913 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Jun 15 14:53:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:53:45.761178 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: DEBUG nova.api.openstack.wsgi [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] Calling method '>' {{(pid=110272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:45.762383 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: INFO nova.api.openstack.requestlog [None req-b874ea12-1f2f-448c-bf73-721da31ad3c6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jun 15 14:53:45.763845 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: [pid: 110272|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Jun 15 14:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:53:45.959811 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG nova.api.openstack.wsgi [None req-0f3544cf-77cf-448b-9172-567e8162293c admin admin] Calling method '>' {{(pid=110273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:53:45.961024 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 14:53:45.961024 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: warnings.warn(msg) Jun 15 14:53:45.962244 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-0f3544cf-77cf-448b-9172-567e8162293c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:45.962686 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-0f3544cf-77cf-448b-9172-567e8162293c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:45.963463 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-0f3544cf-77cf-448b-9172-567e8162293c admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:53:45.963887 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: DEBUG oslo_concurrency.lockutils [None req-0f3544cf-77cf-448b-9172-567e8162293c admin admin] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:53:45.985760 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: INFO nova.api.openstack.requestlog [None req-0f3544cf-77cf-448b-9172-567e8162293c admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080825 Jun 15 14:53:45.986341 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: [pid: 110273|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Jun 15 14:53:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:54:44.511996 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: Wed Jun 15 14:54:44 2022 - graceful shutdown triggered... Jun 15 14:54:44.511539 dv-cinder-845178-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 14:54:44.513019 dv-cinder-845178-7-iscsi devstack@n-api.service[110272]: Gracefully killing worker 1 (pid: 110272)... Jun 15 14:54:44.513398 dv-cinder-845178-7-iscsi devstack@n-api.service[110273]: Gracefully killing worker 2 (pid: 110273)... Jun 15 14:54:45.512553 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: worker 1 buried after 1 seconds Jun 15 14:54:45.512553 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: worker 2 buried after 1 seconds Jun 15 14:54:45.512553 dv-cinder-845178-7-iscsi devstack@n-api.service[110271]: goodbye to uWSGI. Jun 15 14:54:45.514147 dv-cinder-845178-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 14:54:45.514728 dv-cinder-845178-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 14:54:45.518059 dv-cinder-845178-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 14:54:45.532903 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 14:54:45 2022] *** Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: nodename: dv-cinder-845178-7-iscsi Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: machine: x86_64 Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: clock source: unix Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: pcre jit disabled Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: detected number of CPU cores: 4 Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: current working directory: / Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: detected binary path: /usr/bin/uwsgi-core Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: your processes number limit is 47680 Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: your memory page size is 4096 bytes Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: detected max file descriptor number: 2048 Jun 15 14:54:45.534898 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: lock engine: pthread robust mutexes Jun 15 14:54:45.535949 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: thunder lock: enabled Jun 15 14:54:45.535949 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 14:54:45.535949 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 14:54:45.581720 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: Python main interpreter initialized at 0x559a4bff19c0 Jun 15 14:54:45.581720 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: python threads support enabled Jun 15 14:54:45.581720 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: your server socket listen backlog is limited to 100 connections Jun 15 14:54:45.581720 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: your mercy for graceful operations on workers is 90 seconds Jun 15 14:54:45.582192 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 14:54:45.582192 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: *** Operational MODE: preforking *** Jun 15 14:54:45.582485 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: *** uWSGI is running in multiple interpreter mode *** Jun 15 14:54:45.582485 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: spawned uWSGI master process (pid: 124673) Jun 15 14:54:45.582694 dv-cinder-845178-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 14:54:45.586416 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: spawned uWSGI worker 1 (pid: 124694, cores: 1) Jun 15 14:54:45.586416 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: spawned uWSGI worker 2 (pid: 124695, cores: 1) Jun 15 14:54:45.586416 dv-cinder-845178-7-iscsi devstack@n-api.service[124673]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 14:54:46.261153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:54:46.271576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 14:54:47.520282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:54:47.520282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: from cryptography.utils import int_from_bytes Jun 15 14:54:47.521214 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:54:47.521214 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: from cryptography.utils import int_from_bytes Jun 15 14:54:47.561681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:54:47.561681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: from cryptography.utils import int_from_bytes Jun 15 14:54:47.562711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 14:54:47.562711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: from cryptography.utils import int_from_bytes Jun 15 14:54:49.984861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:54:49.985484 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:54:49.985842 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:54:49.986068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:54:49.986353 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:54:49.986768 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.987083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.987410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.987743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.988084 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.988403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.988731 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.989058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.989395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.989664 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.989989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.990993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-7-iscsi {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.990993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.990993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.991265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.991597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.991910 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.992243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.992566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.993060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.994514 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.994514 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.994514 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.994514 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.994844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.995095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.995421 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.995732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.996064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.996395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.996795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-7-iscsi {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.997134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.997449 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.997772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.998212 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.998533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.998851 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.999180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.999508 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:49.999821 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.000184 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.000497 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.001389 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.001704 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.002017 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.002366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.002684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.003015 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.003331 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.003644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.003901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.004215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.004546 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.004875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.005206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.005467 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.005724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.006049 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.006409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.006725 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.007041 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.007356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.007667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.007985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.008301 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.008613 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.008927 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.009254 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.009580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.009913 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.010254 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.010586 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.010992 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.011252 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.011568 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.011920 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.012247 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.012561 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.012892 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.013222 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.013537 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.013847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.014162 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.014513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.014859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.015172 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.015431 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.015739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.016051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.017001 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.017316 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.017747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.018068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.018403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.018718 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.019033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.019601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.019930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.020266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.020592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.020840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.021153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.021466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.021795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.022127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.022505 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.022776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.023092 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.023406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.023733 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.024043 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.024354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.024684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.024994 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.025305 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.025632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.025948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.026287 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.026616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.026924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.027237 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.027560 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.027881 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.028193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.028518 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.028807 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.029117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.029430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.029770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.030050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.030391 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.030713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.031041 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.031359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.031673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.032186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.032617 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.033063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.033336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.033649 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.033978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.035003 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.035003 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.035003 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.035464 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.035609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.035947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.036285 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.036585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.036906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.037235 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.037569 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.037911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.038260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.038636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.038912 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.039235 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.039561 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.039900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.040236 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.040556 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.040904 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.041256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.041580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.041912 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.042277 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.042594 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.042916 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.043232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.043573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.043914 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.044237 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.044593 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.044886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.045206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.045524 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.045846 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.046201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.046539 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.046865 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.047190 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.047540 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.047869 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.048191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.048511 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.048832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.049143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.049457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.049769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.050086 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.050426 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.050759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.051092 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.051407 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.052134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.052134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.052503 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.052737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.052999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.053301 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.053620 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.053945 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.054388 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.054611 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.054930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.055244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.055574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.055887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.056202 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.056526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.056843 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.057163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.057482 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.057797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 14:54:50.058336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.058336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.058636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 14:54:50.058790 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.059048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 14:54:50.059197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.059349 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 14:54:50.059501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.059652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 14:54:50.059809 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.059809 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.060095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.060243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.060501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.060688 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.060934 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.061110 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.061346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.061495 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.061637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.061789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.061940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.062083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.062286 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.062437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.062587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.062751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.062991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.063750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.063901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.064135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.064285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.064633 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.064794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845178-7-iscsi {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.064937 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.065080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.065222 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.065364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.065517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.065680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.065830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.065982 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.066132 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.066338 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.066484 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.066636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.066779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.066921 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.067070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.067070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.067371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.067552 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.067698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.067839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.067995 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.068146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.068289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.068476 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.068632 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.068786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.068938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.069165 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.069315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.069468 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.069618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.069770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.069930 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.070082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.070264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.070421 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.070661 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.070821 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.071135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845178-7-iscsi {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.071413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.071571 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.071714 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.071868 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.072024 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.072168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.072319 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.072470 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.072623 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.072781 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.072933 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.073165 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.073312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.073312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.073600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.073785 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.074585 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.074585 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.074783 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.074871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.074952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.075044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.075128 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.075208 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.075208 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.075342 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.075413 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.075480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.075569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.075661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.075752 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.075835 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.075925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.076015 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.076111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.076201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.076290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.076290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.076453 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.076592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.076816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.076991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.077141 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.077294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.077446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.077601 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.077771 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.077925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.078070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.078259 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.078424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.078584 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.078842 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.079052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.079303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.079455 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.079609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.079753 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.079895 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.080046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.080190 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.080334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.080489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.080660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.080885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.081071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.081291 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.081466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.081701 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.081855 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.082006 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.082157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.082338 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.082491 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.082644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.082790 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.082931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.083073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.083340 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.083501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.083644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.083644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.083916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.084157 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.084308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.084500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.084652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.084794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.084944 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.085088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.085249 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.085403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.085548 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.085696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.086003 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.086226 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.086392 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.086392 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.086681 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.086825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.086965 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.087107 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.087258 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.087413 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.087564 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.087721 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.087884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.088030 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.088185 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.088335 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.088478 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.088629 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.088772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.088922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.089078 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.089223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.089466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.089616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.089777 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.089922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.090074 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.090254 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.090404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.090549 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.090692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.090860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.091081 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.091229 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.091463 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.091631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.091871 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.092035 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.092179 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.092321 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.092463 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.092606 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.092754 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.092913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.093056 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.093206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.093372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.093585 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.093750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.093908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.094064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.094311 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.095070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.095244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.095405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.095563 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.095714 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.095865 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.096017 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.096282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.096447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.096600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.096760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.097510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.097510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.097803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.097956 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.098108 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.098359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.098629 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.098787 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.098938 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.099084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.099084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.099374 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.099616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.099776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.099922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.100072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.100224 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.100375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.100527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.100671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.100814 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.100963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.101204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.101376 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.101614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.101764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.102008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.102165 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.102348 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.102612 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.102765 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.102907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.103057 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.103211 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.103363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.103506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.103757 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.103909 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.104069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.104221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.104221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.104611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.104761 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.104907 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.105063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.105063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.105336 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.105486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.105649 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.105792 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.105944 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.106095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.106297 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 14:54:50.106558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.106715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.106868 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.106868 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.107152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.107302 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.107453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.107604 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.107767 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.107919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.107919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.108215 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.108368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.108513 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.108665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.108857 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.109007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.109159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.109309 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.109453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.109623 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.109851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.110102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.110861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.111109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.111375 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.111547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.111790 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.111948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.112210 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.112365 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.112529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.112679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.112679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.112679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.113129 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.113129 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.113422 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.113572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.113741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.113741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.114116 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.114302 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.114778 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.114955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.115115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.115279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.115279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.115564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.115723 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.115882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.116032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.116188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.116345 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.116510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.116804 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.116965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.117117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.117266 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.117427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.117587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.117744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.117744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.118048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.118048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.118417 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.118586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.118737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.118900 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.119051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.119201 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.119401 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.119401 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.119720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.119894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.120120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.120274 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.120470 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.120627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.120785 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.120943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.121103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.121253 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.121534 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.121716 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.121961 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.122120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.122369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.122537 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.122708 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.122859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.123008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.123163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.123331 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.123489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.123687 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.123842 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124185 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124185 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124340 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124611 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124695 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.124891 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125093 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125284 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125284 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.125935 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.126087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.126375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.126551 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.126741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.126986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.127149 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.127308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.127460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.127636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.127831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.127986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.127986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.128281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.128440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.128670 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.128824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.128973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.129123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.129271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.129271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.129592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.129743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.129935 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.130116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.130401 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.130567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.130727 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.130879 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.131035 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.131192 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.131343 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.131526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.131763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.131960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.132261 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.132507 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.132666 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.132832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.133576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.133742 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.136730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.136987 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.137268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.137432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.137610 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.137782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.137946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.138150 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.138372 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.138535 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.138686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.138851 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.139004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.139288 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.139462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.139621 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.139780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.139955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.140108 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.140291 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.140557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.140715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.140877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.141038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.141038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.141462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.141462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.141782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.141782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.142230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.142537 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.142784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.142939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.143098 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.143259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.143445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.143602 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.143760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.143912 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.144061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.144471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.144627 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.144794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.144945 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.145127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.145484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.145646 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.145806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.145956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.146107 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.146319 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.146485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.146636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.146802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.146954 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.147348 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.147446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.147446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.147663 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.147750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.147835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.147928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148021 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148292 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148384 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148607 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.148964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149149 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149335 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149731 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.149974 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.150095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.164902 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165307 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165656 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.165845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166049 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166379 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166477 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.166972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167322 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167415 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.167928 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168006 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168151 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168283 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168421 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168551 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168687 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.168960 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169049 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169225 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169225 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169458 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169554 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.169916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170386 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170516 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170615 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.170956 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171043 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171353 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171552 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171645 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171742 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.171742 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.172056 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.172239 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.172506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.172506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.173180 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.173344 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.173506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.173676 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.173828 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.174000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.174303 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.174466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.174630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.174792 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.174945 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175254 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175881 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.175993 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.176204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.176332 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.176454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.176567 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.176679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.176790 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.176922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177062 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177239 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177323 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.177951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178133 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178478 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178632 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.178984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179276 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179345 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179504 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179646 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179716 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179799 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.179943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180020 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180097 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180252 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180324 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180401 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180536 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180633 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180718 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.180955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181092 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181229 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.181961 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182148 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182427 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.182920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183005 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183089 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183421 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183701 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183793 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.183979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184079 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184079 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184668 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184753 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184836 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.184926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185106 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185551 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185907 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.185999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186137 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186137 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186465 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186568 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.186940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187084 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187084 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187301 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187388 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.187943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.188029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.188637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.188751 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.188847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.188940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189026 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189431 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189520 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189689 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189782 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189867 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.189965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190304 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190304 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190564 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.190951 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191051 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191138 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191222 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191313 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191498 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191693 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191786 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.191870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192007 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192286 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192799 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192981 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.192981 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.193144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.193238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.193603 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.193701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.193787 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.193872 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.193956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194056 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194149 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194523 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194660 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.194933 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195017 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195309 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195657 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195833 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.195923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196191 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196274 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196380 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196475 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196567 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196662 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196754 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.196931 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197024 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197202 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197276 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197347 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197437 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197528 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197627 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197720 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197812 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197903 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.197989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.198082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.198192 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.198320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.198526 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.198658 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.198781 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.198902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199005 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199189 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.199899 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.200083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.200398 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.200492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.200721 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.200816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.201058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.201154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.201389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.201489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.201708 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.201809 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.202029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.202129 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.202373 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.202504 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.202735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.202869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.203050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.203159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.203365 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.203494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.203692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.204380 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.204645 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.204782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.205058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.205166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.205381 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.205474 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.205702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.205802 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.206022 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.206212 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.206369 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.206462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.206688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.206778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.207002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.207119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.207320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.207486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.207642 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.207750 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.207956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.208059 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.208271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.208363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.208592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.208693 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.208907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.209001 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.209221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.209314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.209538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.209672 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.209850 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.209952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.210220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.210331 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.210505 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.210605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.210824 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.210918 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.211138 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.211240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.211459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.211550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.211773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.211878 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.212084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.212183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.212420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.212522 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.212744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.212845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.213061 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.213204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.213355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.213506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.213674 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.213807 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.213988 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.214089 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.214346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.214471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.214675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.214775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.214994 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.215162 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.215336 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.215443 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.215659 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.215791 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.215978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.216201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.216308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.216546 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.216646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.216873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.216970 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.217217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.217324 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.217539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.217644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.217855 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.217999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.218184 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.218299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.218506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.218644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.218821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.218921 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.219138 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.219241 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.219506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.219614 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.219861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.220053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.220241 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.220378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.220558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.220702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.220878 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.221022 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.221196 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.221343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.221643 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.221737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.221964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.222064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.222333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.222432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.222652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.222753 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.222970 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.223115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.223288 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.223381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.223608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.223736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.223929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.224069 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.224244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.224345 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.224583 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.224675 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.224911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.225019 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.225234 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.225334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.225552 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.225653 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.225872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.226048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.226208 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.233748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.234660 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.234832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.235102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.235290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.235447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.235654 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.235856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.236025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.236221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.236379 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.236379 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.236645 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.236801 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.236953 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.237094 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.237239 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.237239 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.237509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.237712 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.237869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238165 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238700 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238788 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238872 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.238956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239039 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239307 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239391 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239474 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239741 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.239917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240001 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240085 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240178 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240263 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240733 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.240998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241252 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241252 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241894 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.241983 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242321 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242434 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242434 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242757 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.242930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243024 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243555 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243826 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.243957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.244086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.244223 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.244350 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.244486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.244631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.244770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.244901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245179 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245309 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.245989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246131 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246273 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246563 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.246969 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247413 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247505 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247589 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.247949 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248040 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248125 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248218 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248310 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248752 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.248929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249023 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249108 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249276 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249460 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249545 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249721 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249805 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249898 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.249991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.250077 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.250161 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.250286 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.250415 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.250530 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251263 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251450 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251542 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251725 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251809 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.251987 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252070 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252168 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252254 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252338 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252422 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252512 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252734 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.252918 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253104 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253196 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253400 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253543 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253641 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253728 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.253969 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.254145 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.254319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.254517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.254619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.254840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.254942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.255168 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.255268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.255483 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.255612 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.255752 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:54:50.255936 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.256269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.256605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.256949 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.257270 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.257605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.257934 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.258284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.258614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.258942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.259267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.259594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.259920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.260241 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.260569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.260890 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.261245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.261940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.262309 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.262644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.262971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.263299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.263628 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.263990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.264275 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.264611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.264922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.265244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.265646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.266001 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.266696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.273853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.273853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.273853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.273853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.273853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.273853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.273853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.274958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.275557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.276318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.276318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.276318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.276318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.276318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.276763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.276847 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.277145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.277473 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.277811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.278144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.278480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.278800 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.279120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.279437 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.279769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.280088 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.280404 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.280733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.281052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.281591 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.281986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.282374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.282778 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.283118 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.283448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.283769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.284154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.284474 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.284794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.285126 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.285570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.285897 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.286243 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.286571 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.286892 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.287214 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.287539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.287858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.288262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.288514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.288832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.289148 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.289471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.289789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.290105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.290449 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.290766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.291137 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.291454 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.291776 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.292095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.292420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.292739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.293132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.293423 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.293758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.294075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.294418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.294747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.295067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.295402 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.295726 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.296046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.296406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.296732 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.297283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.298279 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.298705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.299061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.299411 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.299733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.300054 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.300374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.300709 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.301033 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.301359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.301719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.302044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.302405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.302756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.303053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.303377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.303695 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.304014 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.304335 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.304657 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.304975 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.305300 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.305654 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.305986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.306337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.306662 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.306995 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.307318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.307638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.307958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.308280 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.308703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.308946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.309271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.309587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.310021 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.310380 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.310711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.311042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.311362 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.311764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.312096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.312417 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.312749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.313234 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.314156 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.314536 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.314880 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.330972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331431 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO dbcounter [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Registered counter for database nova_api Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.331521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.332667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.333870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.335495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.336257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.336257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.336257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.336257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.336257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.336709 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.336937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.337208 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.337539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.337867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.338204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 14:54:50.338465 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 14:54:50.343470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_db.sqlalchemy.engines [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.350437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writer thread running {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.403217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO dbcounter [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Registered counter for database nova_api Jun 15 14:54:50.409902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.context [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bbffb719-9963-4c10-ac0c-7cdf90539028(cell1) {{(pid=124695) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:54:50.414066 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.415664 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.416462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.418486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.420506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO dbcounter [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Registered counter for database nova_cell0 Jun 15 14:54:50.424463 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.424651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO dbcounter [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Registered counter for database nova_cell1 Jun 15 14:54:50.433094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_db.sqlalchemy.engines [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.433303 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writer thread running {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.434075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_db.sqlalchemy.engines [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.450573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writer thread running {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.450573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writer thread running {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.497246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.context [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bbffb719-9963-4c10-ac0c-7cdf90539028(cell1) {{(pid=124694) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 14:54:50.497246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.498647 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.499448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:54:50.501463 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:54:50.503553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO dbcounter [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Registered counter for database nova_cell0 Jun 15 14:54:50.507476 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO dbcounter [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Registered counter for database nova_cell1 Jun 15 14:54:50.514573 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.519556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.521102 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writer thread running {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.592749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO dbcounter [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Registered counter for database nova_cell0 Jun 15 14:54:50.600914 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_db.sqlalchemy.engines [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.605342 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writer thread running {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.667775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writer thread running {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.677019 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO dbcounter [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Registered counter for database nova_cell0 Jun 15 14:54:50.684057 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 14:54:50.690341 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writer thread running {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 14:54:50.927064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: WARNING keystonemiddleware.auth_token [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:54:50.934315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: WARNING keystonemiddleware.auth_token [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:54:51.015836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: WARNING keystonemiddleware.auth_token [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:54:51.023592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: WARNING keystonemiddleware.auth_token [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:54:51.280837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: WARNING keystonemiddleware.auth_token [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:54:51.287163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: WARNING keystonemiddleware.auth_token [None req-90815ce5-4f45-4a8a-9eeb-a59e54da6854 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:54:51.292636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a4bff19c0 pid: 124695 (default app) Jun 15 14:54:51.367634 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: WARNING keystonemiddleware.auth_token [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 14:54:51.373609 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: WARNING keystonemiddleware.auth_token [None req-ae7d6aaa-ed5a-4fba-96f0-3ea80fe65676 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 14:54:51.379533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a4bff19c0 pid: 124694 (default app) Jun 15 14:55:36.206823 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:36.207628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:36.208819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:36.211023 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:36.814771 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1061597755", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "networks": [{"uuid": "f085f6e1-8473-40e2-abbe-5ece07985e2c"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:37.199774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] validate_networks() for [('f085f6e1-8473-40e2-abbe-5ece07985e2c', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:55:38.375692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:55:38.377298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:55:38.378267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:55:38.378267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:55:38.379318 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:55:38.405351 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:38.406617 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:38.407661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:38.412532 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:38.461906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Getting quotas for project dbb7af9fb2864248800c775d2d0d174e. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:55:38.473309 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Getting quotas for user 5fdf869a706a445d950ee8f59595ad4a and project dbb7af9fb2864248800c775d2d0d174e. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:55:38.492188 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:55:38.496069 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:55:38.790637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6e3c4375-2efd-452e-9cba-e66334a8e803 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.589476 Jun 15 14:55:38.791233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:55:39.330447 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-24d3b5a5-e0ab-4143-9748-335b5c4b1211 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:39.335938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-24d3b5a5-e0ab-4143-9748-335b5c4b1211 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:39.340927 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:39.343692 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:39.350382 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:39.351343 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:40.201375 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-24d3b5a5-e0ab-4143-9748-335b5c4b1211 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:40.234474 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-24d3b5a5-e0ab-4143-9748-335b5c4b1211 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1215 microversion: 2.1 time: 1.434759 Jun 15 14:55:40.235278 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 1/2] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:38 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1215 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:41.252718 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-64e8d45b-1b5c-4edb-a696-b0bd2a26d7bb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:41.254012 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-64e8d45b-1b5c-4edb-a696-b0bd2a26d7bb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:41.466349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-64e8d45b-1b5c-4edb-a696-b0bd2a26d7bb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:41.493417 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-64e8d45b-1b5c-4edb-a696-b0bd2a26d7bb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1215 microversion: 2.1 time: 0.242661 Jun 15 14:55:41.494294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:41 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:42.512749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:42.514037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:42.536093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:42.536898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:42.537716 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:42.538161 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:42.834759 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:42.849519 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5defe3e6-3411-4937-beba-8ab6017f68f4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1219 microversion: 2.1 time: 0.340589 Jun 15 14:55:42.851378 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:42 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1219 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:43.870050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:43.871204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:43.894045 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:43.896186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:43.906060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:43.906682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:44.228427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:44.257839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8acec962-bd95-481b-a8d6-3b8bc015815c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1267 microversion: 2.1 time: 0.393786 Jun 15 14:55:44.260871 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:43 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1267 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:45.285979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:45.286607 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:45.297619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:45.298077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:45.299809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:45.303551 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:45.411314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:45.423771 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e7180c38-37cf-48f8-9a90-f0606ffe394e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1275 microversion: 2.1 time: 0.141971 Jun 15 14:55:45.429236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:45 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1275 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:46.442080 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:46.446066 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:46.458700 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:46.459171 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:46.462188 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:46.462665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:46.920246 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:46.934383 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c90f3358-c68b-4ab2-b6f4-d4f2b0805c7b tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1275 microversion: 2.1 time: 0.497147 Jun 15 14:55:46.950100 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:46 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1275 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:47.956264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:47.957307 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:47.999342 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.003425 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.007395 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:48.007948 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:48.565254 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:48.578943 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-66958bdc-4f2d-41b8-89fd-fa50c9ea6b8e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1273 microversion: 2.1 time: 0.629551 Jun 15 14:55:48.582957 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:47 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1273 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:49.597934 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:49.598796 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:49.633207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:49.633207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.633207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.633207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:49.640680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:49.838839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:49.866256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dfba21cc-9876-41bc-a78c-cebaafd4a2be tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1273 microversion: 2.1 time: 0.264674 Jun 15 14:55:49.870494 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:49 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:50.453594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-53d7a78d-b270-437d-94aa-0ac23bba2eea tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'create', calling method: .version_select at 0x7f6940a0c4c0>, body: {"keypair": {"name": "tempest-keypair-1061284394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhI+nkoz36M5YqAOxZj5Ur+IoWqYp/9+EznnoDmY5gj1ybXd/s8DPkLdlnALpkEBdDv6aP7RRPPwplHTv95Z73Zb7Z9Ee7enlaouf6pRWwEA1jU+Oz7UcM02aywB70vLw=="}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:50.620274 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-53d7a78d-b270-437d-94aa-0ac23bba2eea tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:55:50.653490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-53d7a78d-b270-437d-94aa-0ac23bba2eea tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for user bf1b5d8cbfbb450da8878719c4aa6712 and project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:55:50.897637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:50.898545 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:50.924652 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:50.925119 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:50.935589 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:50.936228 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:51.080518 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-53d7a78d-b270-437d-94aa-0ac23bba2eea tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.296966 Jun 15 14:55:51.081145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 5/10] 10.222.0.23 () {62 vars in 1199 bytes} [Wed Jun 15 14:55:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1299 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 14:55:51.482592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=8 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:55:52.136705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:52.149037 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c8eb4c42-171d-4a8d-831f-f73b0714aaa4 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 1.262585 Jun 15 14:55:52.150780 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:50 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:53.167975 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:53.169395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:53.183766 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.183766 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:53.184768 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:53.185392 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:53.220746 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ae1a445f-4c30-4876-bac9-5d8280308d02 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'create', calling method: .version_select at 0x7f69409cedc0>, body: {"keypair": {"name": "tempest-keypair-1972416882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYxKQ2LIamnaKE4ZQDLMN0GxemNh2/Oo+3Tgpv7YIBBD5kCzpWHaEg/8XFxtHgeV+xecyIZopD/OCljADAq1bMHMqJvac3lkIeXgzCvOck4w25sKFzJO6uXkIZLQewKyg=="}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:53.254333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-ae1a445f-4c30-4876-bac9-5d8280308d02 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:55:53.265559 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-ae1a445f-4c30-4876-bac9-5d8280308d02 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for user df400aee39a3498d8a26d55180075ab6 and project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:55:53.486733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ae1a445f-4c30-4876-bac9-5d8280308d02 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.561471 Jun 15 14:55:53.487842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 6/12] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 14:55:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:54.795485 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:54.835630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-57a01672-ea7f-4460-a378-58a847a60150 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 1.671408 Jun 15 14:55:54.835630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:53 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:55:55.859564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:55.860174 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:55.884966 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.885408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:55.886223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:55.886674 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:56.504179 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1824309458", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:56.621549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] validate_networks() for [('19a21454-d50c-4eae-a0c5-6c91a597b220', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:55:57.592085 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:57.623548 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-348a29ed-3c41-493b-ab29-9313ad7b3ce9 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 1.767671 Jun 15 14:55:57.624074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:55 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:57.826963 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-74d87bed-acef-45e0-90e9-03899dbaad9f req-32fc82f4-9efe-477c-982b-bd603d957dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c67599e9-f38f-44ad-8211-3976ee2473bb", "tag": "62e514f1-dd0d-47a1-90f8-ae167257f235"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:55:57.876279 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-74d87bed-acef-45e0-90e9-03899dbaad9f req-32fc82f4-9efe-477c-982b-bd603d957dab service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.876702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-74d87bed-acef-45e0-90e9-03899dbaad9f req-32fc82f4-9efe-477c-982b-bd603d957dab service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.977513 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-74d87bed-acef-45e0-90e9-03899dbaad9f req-32fc82f4-9efe-477c-982b-bd603d957dab service nova] Creating event network-changed:62e514f1-dd0d-47a1-90f8-ae167257f235 for instance c67599e9-f38f-44ad-8211-3976ee2473bb on hv-cinder-84517 Jun 15 14:55:57.978470 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-74d87bed-acef-45e0-90e9-03899dbaad9f req-32fc82f4-9efe-477c-982b-bd603d957dab service nova] Acquired lock "compute-rpcapi-router" {{(pid=124694) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:55:57.981553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14716d3f-5cc5-4197-897e-a1b20114504d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.983442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14716d3f-5cc5-4197-897e-a1b20114504d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:57.987752 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14716d3f-5cc5-4197-897e-a1b20114504d None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:57.988832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14716d3f-5cc5-4197-897e-a1b20114504d None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:58.024756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.compute.rpcapi [None req-14716d3f-5cc5-4197-897e-a1b20114504d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:55:58.025957 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14716d3f-5cc5-4197-897e-a1b20114504d None None] Releasing lock "compute-rpcapi-router" {{(pid=124694) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:55:58.079075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-14716d3f-5cc5-4197-897e-a1b20114504d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.453672 Jun 15 14:55:58.082308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:55:58.655927 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:55:58.655927 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:55:58.680071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.682869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:58.684037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:58.688757 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:59.509581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:55:59.509581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-90cb2432-5ef9-43ee-a1cf-f9d689a4a357 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.676922 Jun 15 14:55:59.509581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:55:58 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:55:59.714442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:55:59.715094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:55:59.715696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:55:59.716325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:55:59.716970 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:55:59.738825 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:59.739282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:59.740106 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:55:59.740548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:55:59.862206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:55:59.899293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for user cbc9d5ce4a3241ea898f216543114fdf and project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:55:59.937529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:55:59.947815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:56:00.516146 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:00.516778 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:00.544179 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:00.545155 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:00.546535 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:00.547248 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:00.682753 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-fe9608c0-8fa0-4198-b043-4b63ad1f161a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.516552 Jun 15 14:56:00.686218 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 8/17] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:55:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 4520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:56:00.734636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c3afaac8-1a9c-4e79-a162-a3abc5555466 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:00.743764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c3afaac8-1a9c-4e79-a162-a3abc5555466 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:01.091653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c3afaac8-1a9c-4e79-a162-a3abc5555466 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:01.108441 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c3afaac8-1a9c-4e79-a162-a3abc5555466 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1222 microversion: 2.1 time: 0.406161 Jun 15 14:56:01.110236 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:00 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1222 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:01.312149 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:01.336046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9aac29b1-c6bd-4ddb-8e82-f922cf917914 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.824841 Jun 15 14:56:01.341577 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 10/19] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:00 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:01.585998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1112045036", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:01.788542 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1cd9116a-5a11-4d25-ae72-77334596e662 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: .version_select at 0x7f69400beee0>, body: {"keypair": {"name": "tempest-keypair-12088609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkw8HnyE0kkG31VJDp6wKjofiGGHYzhjVu9l4twH/n/tI+hWbWwgudBYDJmgaBck0uMQpiOb7pzuMVG3aEIYiJOuW+zf6fuvNoakd0+Mfe25nwoqxosOtecej31ciWRgQ=="}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:01.821073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] validate_networks() for [('19a21454-d50c-4eae-a0c5-6c91a597b220', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:56:01.911245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-1cd9116a-5a11-4d25-ae72-77334596e662 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:56:01.916212 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-1cd9116a-5a11-4d25-ae72-77334596e662 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:56:02.568646 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1cd9116a-5a11-4d25-ae72-77334596e662 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.368433 Jun 15 14:56:02.568646 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 14:56:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:02.575562 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:02.576724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:02.588770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:02.592313 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:02.594618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:02.595281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:03.088950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:03.104818 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6be1e2a1-c328-4e09-8910-e00e2c2f1fb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.533873 Jun 15 14:56:03.123253 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:02 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:03.291360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=10 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:03.474152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:56:03.475004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:56:03.475716 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:56:03.476337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:56:03.477153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:56:03.509057 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:03.512694 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:03.514499 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:03.519095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:03.632594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:56:03.640079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for user cbc9d5ce4a3241ea898f216543114fdf and project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:56:03.681743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:56:03.691990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:56:04.137285 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:04.146466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:04.146834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-52883029-18ee-436a-a5a6-3f4e0a09a4a0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.570343 Jun 15 14:56:04.147977 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 11/22] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:56:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:56:04.164738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a5010556-a80e-490c-a51d-c4e9fcef89f5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:04.165960 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a5010556-a80e-490c-a51d-c4e9fcef89f5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:04.202220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:04.202698 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:04.203516 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:04.203960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:04.462929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a5010556-a80e-490c-a51d-c4e9fcef89f5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:04.462929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a5010556-a80e-490c-a51d-c4e9fcef89f5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1222 microversion: 2.1 time: 0.272655 Jun 15 14:56:04.462929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:04 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:04.856344 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:04.874567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e9ce0d45-d6c1-43f6-a6a7-710e51194144 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.750819 Jun 15 14:56:04.890799 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:04 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:05.474617 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-bb8da786-7683-4e34-a9b2-0ed3097fbba5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:05.476121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-bb8da786-7683-4e34-a9b2-0ed3097fbba5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:05.599137 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-802673184", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73440024-15c7-43b4-be7e-06dddac720f4"}], "security_groups": [{"name": "tempest-securitygroup--1976500415"}], "key_name": "tempest-keypair-1061284394", "user_data": "}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:05.695006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bb8da786-7683-4e34-a9b2-0ed3097fbba5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:05.711323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-bb8da786-7683-4e34-a9b2-0ed3097fbba5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1222 microversion: 2.1 time: 0.265457 Jun 15 14:56:05.715144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:05 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1222 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:05.773123 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] validate_networks() for [('73440024-15c7-43b4-be7e-06dddac720f4', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:56:05.897925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:05.899332 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:05.908529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:05.911289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:05.912032 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:05.914867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:06.380315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:06.387681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c643141b-a02e-401d-878a-e8abaa02fd74 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.495347 Jun 15 14:56:06.388247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:05 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:06.620653 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1098227671", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05bfcb97-d977-4a20-a34c-9858d88e885b"}], "security_groups": [{"name": "tempest-securitygroup--387808730"}], "key_name": "tempest-keypair-1972416882", "user_data": "}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:06.683413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:56:06.683962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:56:06.684387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:56:06.684808 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:56:06.685225 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:56:06.706248 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:06.710848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:06.712041 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:06.712888 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:06.738288 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:56:06.747490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for user bf1b5d8cbfbb450da8878719c4aa6712 and project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:56:06.761129 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:56:06.764392 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:56:06.800061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] validate_networks() for [('05bfcb97-d977-4a20-a34c-9858d88e885b', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:56:06.984830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7c495253-0849-4312-a845-389f0f765702 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.392745 Jun 15 14:56:06.991288 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 13/27] 10.222.0.23 () {62 vars in 1187 bytes} [Wed Jun 15 14:56:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 14:56:07.027705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:07.028482 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:07.058200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.060661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.072239 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.072239 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.296932 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.310525 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a2ea035b-791c-45d5-aafe-ec119cbef7d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1226 microversion: 2.1 time: 0.317567 Jun 15 14:56:07.312569 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 14/28] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:06 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1226 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:07.319580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0d7bd883-de20-4bca-925e-9e737a49d704 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:07.324171 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0d7bd883-de20-4bca-925e-9e737a49d704 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:07.395201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0d7bd883-de20-4bca-925e-9e737a49d704 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.405193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0d7bd883-de20-4bca-925e-9e737a49d704 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.406905 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0d7bd883-de20-4bca-925e-9e737a49d704 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.433104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0d7bd883-de20-4bca-925e-9e737a49d704 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1281 microversion: 2.20 time: 0.100634 Jun 15 14:56:07.433104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 15/29] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:07 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:07.433104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:07.433104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:07.433667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.434121 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.435034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.435486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.594689 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:56:07.595122 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:56:07.595760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:56:07.596181 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:56:07.596667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:56:07.606188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.606653 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.607454 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:07.607966 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:07.623027 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:07.625263 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=59 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:07.628192 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:56:07.632245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for user df400aee39a3498d8a26d55180075ab6 and project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:56:07.633588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e3bf9518-453f-4a2f-bb74-f7f8ca9cbaf1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.210324 Jun 15 14:56:07.634154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 16/30] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:07 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:07.645987 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:56:07.648205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:56:07.986739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-075211d6-6054-422f-8a50-532028db65a0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.370386 Jun 15 14:56:07.994693 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 15/31] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:56:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:56:08.005796 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c0171a74-7421-4359-a871-ccd456b4483f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:08.009325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c0171a74-7421-4359-a871-ccd456b4483f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:08.009325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:08.068502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c0171a74-7421-4359-a871-ccd456b4483f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:08.077481 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c0171a74-7421-4359-a871-ccd456b4483f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1238 microversion: 2.1 time: 0.075980 Jun 15 14:56:08.090324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 17/32] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:08 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:08.329649 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:08.330687 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:08.337661 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.338125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:08.338953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.339403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:08.416985 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:08.425716 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7425332c-d9cd-4673-ae4e-e7cdfc8d28c0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1226 microversion: 2.1 time: 0.100086 Jun 15 14:56:08.426412 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 16/33] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:08 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:08.446502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-17030ce8-cc30-47f8-a365-db0db3efd5ae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:08.447124 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-17030ce8-cc30-47f8-a365-db0db3efd5ae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:08.516769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-17030ce8-cc30-47f8-a365-db0db3efd5ae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:08.530667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-17030ce8-cc30-47f8-a365-db0db3efd5ae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:08.532678 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-17030ce8-cc30-47f8-a365-db0db3efd5ae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:08.539873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-980270634", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f4844db-ed6c-4bba-97af-aa7e459b2e26"}], "security_groups": [{"name": "tempest-securitygroup--829252336"}], "key_name": "tempest-keypair-12088609", "user_data": "}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:08.550898 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-17030ce8-cc30-47f8-a365-db0db3efd5ae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1281 microversion: 2.20 time: 0.114540 Jun 15 14:56:08.551515 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 18/34] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:08 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:08.654598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:08.655534 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:08.664046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.664728 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:08.665572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:08.666098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:08.687718 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] validate_networks() for [('6f4844db-ed6c-4bba-97af-aa7e459b2e26', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:56:08.929800 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:08.943786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c220e10c-4433-4eba-851d-44be9e250d9c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.292795 Jun 15 14:56:08.943786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 19/35] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:08 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:09.095345 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7c37cbc9-9c0e-47f9-a52d-8b48d2c79f6f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:09.096746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7c37cbc9-9c0e-47f9-a52d-8b48d2c79f6f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:09.178587 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7c37cbc9-9c0e-47f9-a52d-8b48d2c79f6f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.185722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7c37cbc9-9c0e-47f9-a52d-8b48d2c79f6f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1238 microversion: 2.1 time: 0.094388 Jun 15 14:56:09.186316 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 20/36] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:09 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:09.315165 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:56:09.315920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:56:09.316424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:56:09.317438 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:56:09.317884 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:56:09.331148 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.331674 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.332737 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.333332 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.357336 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:56:09.362094 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:56:09.364770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:09.374728 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:56:09.377186 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:56:09.452765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:09.453847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:09.465497 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.466385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.467666 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.468194 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.552036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.559519 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dbab3472-2c83-45b6-9cf8-2b6bf96ea401 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1274 microversion: 2.1 time: 0.111843 Jun 15 14:56:09.560094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 21/37] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:09 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:09.561203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-98c93d89-f4d9-4967-9469-579c6d4ebb27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.027543 Jun 15 14:56:09.561846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 17/38] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:56:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:56:09.573692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:09.573963 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f2a9fa8e-699f-4f5e-b292-ab88fefe30b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:09.574813 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f2a9fa8e-699f-4f5e-b292-ab88fefe30b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:09.577555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:09.596779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.598459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.599430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.609435 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.666765 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f2a9fa8e-699f-4f5e-b292-ab88fefe30b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.680602 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f2a9fa8e-699f-4f5e-b292-ab88fefe30b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1239 microversion: 2.1 time: 0.106468 Jun 15 14:56:09.683890 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 18/39] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:09 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1239 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:09.724605 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.735583 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.738522 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:09.739967 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e052b5d9-6f63-4084-90e5-d87ccc3d4e89 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1277 microversion: 2.20 time: 0.171387 Jun 15 14:56:09.741100 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 22/40] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:09 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:09.956401 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:09.957103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:09.963141 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.963599 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:09.966588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:09.966588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.100021 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.107756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-02f49c3f-1eb7-4d30-855c-f70d93552ce2 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.155405 Jun 15 14:56:10.108406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:09 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:10.203093 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:10.203716 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:10.210887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.211334 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.212099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.212529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.279758 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.288858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7735363f-5b8a-4c3b-8b5f-0bc90ea776d1 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1242 microversion: 2.1 time: 0.089514 Jun 15 14:56:10.289533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 23/42] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:10 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:10.576774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:10.577707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:10.585777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.586265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.594806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.595366 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.665892 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.673300 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2eda085e-b751-4f00-931b-7216d78e93c3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1274 microversion: 2.1 time: 0.100309 Jun 15 14:56:10.674407 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:10 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:10.701059 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b08d9b78-e69b-4185-825a-63058602a40b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:10.701672 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b08d9b78-e69b-4185-825a-63058602a40b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:10.758601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b08d9b78-e69b-4185-825a-63058602a40b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.760399 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:10.761051 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:10.765964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b08d9b78-e69b-4185-825a-63058602a40b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1239 microversion: 2.1 time: 0.068887 Jun 15 14:56:10.772186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 24/44] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:10 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:10.772326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.772326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.772326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:10.772326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:10.837365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.849264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.851289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:10.853257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7fcc1741-017d-4a72-9e6f-1491088fbeb3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1277 microversion: 2.20 time: 0.097611 Jun 15 14:56:10.855170 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 21/45] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:10 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:11.130933 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:11.130933 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:11.132426 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.133089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.133834 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.134360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.291774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.305447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-caf7d774-be65-41ac-a248-3dc145b6197f tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.185187 Jun 15 14:56:11.306020 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:11.306475 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 25/46] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:11 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:11.307013 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:11.312866 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.313315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.314076 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.315263 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.397811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.397811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f2cbca27-5ac4-4ee8-887d-b14cf84d3053 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1242 microversion: 2.1 time: 0.087532 Jun 15 14:56:11.397811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 22/47] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:11 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:11.694844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:11.694844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:11.697452 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.698042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.698950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.699402 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.762042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.770850 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7a01a931-73f8-4b61-a603-4a47290d8bb6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1274 microversion: 2.1 time: 0.084090 Jun 15 14:56:11.771406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 26/48] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:11 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:11.793351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:11.794004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:11.801575 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.802222 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.803003 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.803443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.873951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.875433 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:11.876273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:11.882037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f7b17a35-8849-4bd9-a147-7b769c4449e4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1243 microversion: 2.1 time: 0.092982 Jun 15 14:56:11.888470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.888470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.888470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:11.888470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:11.891462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 23/49] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:11 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1243 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:11.953450 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.961692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.963422 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:11.964525 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ef1cc35e-d843-41dd-bf2b-837257a965b3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1277 microversion: 2.20 time: 0.092955 Jun 15 14:56:11.965063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 27/50] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:11 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:12.322573 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:12.323191 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:12.329436 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.329892 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.331265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.331794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.409940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:12.410833 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:12.418432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.418962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.423932 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.423932 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.521773 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.529293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.545475 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=93 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:12.553465 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a2f35ba5-9e59-4646-b226-ce8950f5d6ca tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.234766 Jun 15 14:56:12.557849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 24/51] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:12 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:12.565523 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-633f39cf-17cb-465d-8607-19aac8ce7e03 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1242 microversion: 2.1 time: 0.160249 Jun 15 14:56:12.575384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 28/52] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:12 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1242 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:12.798132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:12.798132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:12.809617 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.810306 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.811242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.815884 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.900588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:12.901206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:12.909850 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.910334 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.911103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:12.911540 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:12.912193 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.922700 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f8c6e0a4-e7c0-4ae9-8791-b8d1800203b6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1274 microversion: 2.1 time: 0.136976 Jun 15 14:56:12.938618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 25/53] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:12 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:12.981897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:12.984214 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:12.985308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:12.991219 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c54805c8-0b7e-4ff0-89bc-10307c38a763 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1243 microversion: 2.1 time: 0.094960 Jun 15 14:56:12.991992 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 29/54] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:12 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1243 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:12.993482 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.007980 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.007980 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.007980 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.076376 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.088262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.090121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.091455 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-21e78dc2-ee51-4bf3-9a43-0173892bf7d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1277 microversion: 2.20 time: 0.112118 Jun 15 14:56:13.092013 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 26/55] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:12 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:13.581204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:13.581966 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:13.583424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:13.585086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:13.589961 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.591570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.591717 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.592426 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.593028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.593867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.593986 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.594639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.683202 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.694496 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-84728440-f0ae-4420-9136-06e6731b327d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1234 microversion: 2.1 time: 0.115212 Jun 15 14:56:13.695416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 27/56] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:13 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1234 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:13.760072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:13.768259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d5d14454-8e60-4e81-8218-babbf5a67693 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.191877 Jun 15 14:56:13.769115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 30/57] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:13 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:13.938246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-2270c39f-c3b8-4773-bd49-ebbf245fd4f1 req-46fe49af-e862-48db-8c5a-9a5777e012de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbdc341-c8d4-435d-a52c-9e4387a70cfc", "tag": "8ec702c0-ce7f-483c-b9dc-e27046ef0c8d"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:13.941072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:13.942034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:13.951978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.952485 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.953266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.953702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:13.974318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-2270c39f-c3b8-4773-bd49-ebbf245fd4f1 req-46fe49af-e862-48db-8c5a-9a5777e012de service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:13.974318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-2270c39f-c3b8-4773-bd49-ebbf245fd4f1 req-46fe49af-e862-48db-8c5a-9a5777e012de service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.008234 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-2270c39f-c3b8-4773-bd49-ebbf245fd4f1 req-46fe49af-e862-48db-8c5a-9a5777e012de service nova] Creating event network-changed:8ec702c0-ce7f-483c-b9dc-e27046ef0c8d for instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc on hv-cinder-84517 Jun 15 14:56:14.015383 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-2270c39f-c3b8-4773-bd49-ebbf245fd4f1 req-46fe49af-e862-48db-8c5a-9a5777e012de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080808 Jun 15 14:56:14.016823 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 28/58] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:14.036685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:14.037734 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:14.046241 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.047052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.048311 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.050135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.135795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:14.151643 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-afd66bf0-b999-4e55-98b7-c227b27849be tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1292 microversion: 2.1 time: 0.215439 Jun 15 14:56:14.158108 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 31/59] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:13 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1292 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:14.169653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:14.170587 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:14.198765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.199235 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.200143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.200590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.213789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:14.223611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-bb72dd67-f638-4f28-809c-5be5c99f1fbd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1291 microversion: 2.1 time: 0.194956 Jun 15 14:56:14.230314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 29/60] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:14 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1291 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:14.298132 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:14.311174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:14.313318 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:14.315290 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b2dd52d5-90d1-4deb-b6cb-9614d6e288be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1341 microversion: 2.20 time: 0.157011 Jun 15 14:56:14.316124 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 32/61] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:14 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:14.715555 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:14.767445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:14.767445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.767445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.767445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.768727 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.788146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:14.788774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:14.801359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.801877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.802699 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:14.803477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:14.884212 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:14.895821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b7f058fa-fd48-41ee-914e-bdf5cc98e5dc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1290 microversion: 2.1 time: 0.187226 Jun 15 14:56:14.897120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 30/62] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:14 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1290 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:15.061720 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:15.070536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b90da5db-9480-4844-8764-6b932bb55582 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.288152 Jun 15 14:56:15.071632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:14 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:15.177288 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:15.178287 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:15.188950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:15.190756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:15.194991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:15.196359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:15.241486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:15.242368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:15.256368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:15.258101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:15.259096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:15.261492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:15.750159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:15.758521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-01b26e96-1dbc-4b55-b107-46c524a9f6bc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1299 microversion: 2.1 time: 0.520784 Jun 15 14:56:15.769059 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 34/64] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:15 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1299 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:16.044105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.045263 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-885d239e-4d5f-45bb-985b-1e352834a817 req-6fdb2cd4-c53f-4e58-9170-0626a08a29eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c67599e9-f38f-44ad-8211-3976ee2473bb", "name": "network-vif-plugged", "status": "completed", "tag": "62e514f1-dd0d-47a1-90f8-ae167257f235"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:16.052678 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7d814ac9-970c-471b-844e-fc8ec997cb75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.881558 Jun 15 14:56:16.058987 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 31/65] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:15 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:16.059499 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-885d239e-4d5f-45bb-985b-1e352834a817 req-6fdb2cd4-c53f-4e58-9170-0626a08a29eb service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.060253 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-885d239e-4d5f-45bb-985b-1e352834a817 req-6fdb2cd4-c53f-4e58-9170-0626a08a29eb service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.067705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:16.068320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:16.085847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-885d239e-4d5f-45bb-985b-1e352834a817 req-6fdb2cd4-c53f-4e58-9170-0626a08a29eb service nova] Creating event network-vif-plugged:62e514f1-dd0d-47a1-90f8-ae167257f235 for instance c67599e9-f38f-44ad-8211-3976ee2473bb on hv-cinder-84517 Jun 15 14:56:16.086710 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-885d239e-4d5f-45bb-985b-1e352834a817 req-6fdb2cd4-c53f-4e58-9170-0626a08a29eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=124695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 14:56:16.088130 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f8599975-14a7-4305-996e-135643a8b18e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.088759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f8599975-14a7-4305-996e-135643a8b18e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.089972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f8599975-14a7-4305-996e-135643a8b18e None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.090353 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.090722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f8599975-14a7-4305-996e-135643a8b18e None None] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.090857 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.091659 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.092105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.101492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.compute.rpcapi [None req-f8599975-14a7-4305-996e-135643a8b18e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 14:56:16.102691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f8599975-14a7-4305-996e-135643a8b18e None None] Releasing lock "compute-rpcapi-router" {{(pid=124695) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 14:56:16.134799 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f8599975-14a7-4305-996e-135643a8b18e None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.364081 Jun 15 14:56:16.135670 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 35/66] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:16.156586 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:16.157340 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:16.169220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.169673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.170643 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.171250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.233595 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.246655 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.248214 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.262963 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d492ad64-7ff0-43d1-8a82-e0bdf60d368a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1339 microversion: 2.20 time: 0.189369 Jun 15 14:56:16.264389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 32/67] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:16 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:16.276412 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:16.277243 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:16.285587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.286206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.291877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.292346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.329836 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.338520 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-da4d9113-8aa9-43cf-aa2f-bf4add4975c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1296 microversion: 2.1 time: 0.196221 Jun 15 14:56:16.339471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 36/68] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:16 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:16.776413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:16.777121 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:16.783111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.783798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.797737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:16.797737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:16.840124 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.849705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-319b2183-350c-4bde-97b9-ff300aaf5e30 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.584061 Jun 15 14:56:16.850420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 33/69] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:16 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:16.905738 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:16.908980 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:16.915324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-64f5d42f-15e3-4428-bd96-45c7a761d130 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1297 microversion: 2.1 time: 0.143183 Jun 15 14:56:16.915992 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 37/70] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:16 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:16.986039 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-14571b92-9176-49d3-870f-abfd8eda7e7e req-94bcbbea-d920-4e03-90e0-430fa3d7416b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff1fa86-018b-467f-a6cf-63db9cbba893", "tag": "f1c6c166-89bd-466b-9b18-5bb2233786d8"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:16.998619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-14571b92-9176-49d3-870f-abfd8eda7e7e req-94bcbbea-d920-4e03-90e0-430fa3d7416b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.000719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-14571b92-9176-49d3-870f-abfd8eda7e7e req-94bcbbea-d920-4e03-90e0-430fa3d7416b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.024450 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-14571b92-9176-49d3-870f-abfd8eda7e7e req-94bcbbea-d920-4e03-90e0-430fa3d7416b service nova] Creating event network-changed:f1c6c166-89bd-466b-9b18-5bb2233786d8 for instance aff1fa86-018b-467f-a6cf-63db9cbba893 on hv-cinder-84517 Jun 15 14:56:17.031244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-14571b92-9176-49d3-870f-abfd8eda7e7e req-94bcbbea-d920-4e03-90e0-430fa3d7416b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051506 Jun 15 14:56:17.036972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 34/71] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:17.070523 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:17.071144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:17.077966 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.078448 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.079231 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.079674 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.291226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:17.291922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:17.302075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.302075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.302075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.302075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.452397 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.462711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.464216 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.466406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b197de81-980c-429f-9352-112acf816453 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1339 microversion: 2.20 time: 0.179169 Jun 15 14:56:17.472802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 35/72] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:17 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:17.474648 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:17.475444 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:17.481549 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.482190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.483162 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.484016 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.508742 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.513324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-fe1432d9-4b8f-4d80-b0f9-1965fa0bf5ff tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.446543 Jun 15 14:56:17.514000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 38/73] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:17 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:17.569075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:17.576718 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-569ef78c-cf64-4a26-b4e1-22f322ba83ba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1296 microversion: 2.1 time: 0.108115 Jun 15 14:56:17.577282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:17 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:17.867877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:17.869414 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:17.876158 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.877458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.878447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.879064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.932928 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:17.933579 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:17.940473 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.965153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:17.965153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:17.965153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.155003 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:18.166957 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4f3b202b-a489-4179-a6c4-e6b38914aa45 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1297 microversion: 2.1 time: 0.237678 Jun 15 14:56:18.174260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 37/75] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:17 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1297 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:18.332673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:18.342010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8a9feaba-0222-41a5-a02a-2f9a43226ba8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.478057 Jun 15 14:56:18.342608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 39/76] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:17 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:18.490926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:18.492514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:18.499408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.500059 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.500983 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.501710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.530713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:18.531111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:18.542230 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.542677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.546496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:18.551409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:18.998528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:19.002557 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:19.005835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:19.008052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:19.009349 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-22b601ef-4b7a-43d7-9510-1a1feb8aa668 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.522418 Jun 15 14:56:19.009898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 38/77] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:18 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:19.010007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4e046a41-87ba-40d7-976d-7f17ab760446 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.483513 Jun 15 14:56:19.015102 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:19.024632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:18 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:19.032231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:19.032231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.032924 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.034326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.034769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.191918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:19.193319 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:19.199664 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.200268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.201136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.201673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.344984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=8 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:19.613839 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:19.623143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ab9b69c8-fdb3-402b-a5fc-830e1f3796a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.611573 Jun 15 14:56:19.633846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:19 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:19.638985 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:19.639820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:19.646983 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.647709 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.653450 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:19.654289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:19.677154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=24 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:19.830948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:19.830948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ca5f5c81-b8fd-4362-8ba5-40327f9ff774 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.606227 Jun 15 14:56:19.830948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 41/80] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:19 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:20.031073 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:20.031683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:20.038837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.039285 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.040054 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.040523 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.250364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.259364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-41de0a16-4dd6-4a90-a864-f565ec3c400c tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1315 microversion: 2.1 time: 0.624121 Jun 15 14:56:20.269822 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 40/81] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:19 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:20.275589 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:20.276426 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:20.287696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.287696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.287696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.287696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.698684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.712574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.714931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.718684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-38a8c3d7-bbcb-4567-ad53-5d818e40855d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.691299 Jun 15 14:56:20.729718 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 42/82] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:20 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:20.735222 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:20.736496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:20.743632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.744090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.744873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.745317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.763845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=28 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:20.960058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:20.960058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-24bdfcea-31ea-4a6c-90bb-4f0022b89e84 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.686610 Jun 15 14:56:20.960058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:20 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:20.964674 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:20.965343 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:20.978984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.979438 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:20.980205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:20.980638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.125659 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:21.134662 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9ead16a0-576d-45b6-95a4-99553263c475 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.408647 Jun 15 14:56:21.136787 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 43/84] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:20 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:21.218875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:21.222873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:21.227434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9ebae8f8-a87b-458e-83b2-d262cdc90a4c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.267534 Jun 15 14:56:21.228176 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:20 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:21.239942 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-2489f28b-7435-485e-b93c-56f57319bd14 req-12145ed9-7528-479f-a8a3-d5033e6733f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbdc341-c8d4-435d-a52c-9e4387a70cfc", "name": "network-vif-plugged", "status": "completed", "tag": "8ec702c0-ce7f-483c-b9dc-e27046ef0c8d"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:21.248346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-2489f28b-7435-485e-b93c-56f57319bd14 req-12145ed9-7528-479f-a8a3-d5033e6733f9 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.253445 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-2489f28b-7435-485e-b93c-56f57319bd14 req-12145ed9-7528-479f-a8a3-d5033e6733f9 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.261014 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-2489f28b-7435-485e-b93c-56f57319bd14 req-12145ed9-7528-479f-a8a3-d5033e6733f9 service nova] Creating event network-vif-plugged:8ec702c0-ce7f-483c-b9dc-e27046ef0c8d for instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc on hv-cinder-84517 Jun 15 14:56:21.266257 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-2489f28b-7435-485e-b93c-56f57319bd14 req-12145ed9-7528-479f-a8a3-d5033e6733f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036993 Jun 15 14:56:21.267076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 44/86] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:21.277572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:21.278326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:21.294206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.294965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.295907 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.296540 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.740408 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:21.741334 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:21.757419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.757827 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:21.758641 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:21.759477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.035318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.043300 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e9266671-11b0-4e65-9797-b7740e665b86 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1501 microversion: 2.1 time: 0.770236 Jun 15 14:56:22.044055 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 43/87] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:21 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1501 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:22.155882 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.169361 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.171132 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.173398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a03d2161-1e7e-46f1-9cd5-e0d7c3c8455b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.439596 Jun 15 14:56:22.174696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 45/88] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:21 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:22.180045 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:22.180743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:22.197004 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.197739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.198776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.199273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.275703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-b389f71c-4021-4baf-bbd1-a966ce359ebf req-2adfcebc-7703-4021-9258-a1f08776d1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6014d-9ea6-47c4-af6c-719e09d8d193", "tag": "08f6804f-9163-46e0-a8a3-e6d5513b1c44"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:22.287507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-b389f71c-4021-4baf-bbd1-a966ce359ebf req-2adfcebc-7703-4021-9258-a1f08776d1e6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.287962 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-b389f71c-4021-4baf-bbd1-a966ce359ebf req-2adfcebc-7703-4021-9258-a1f08776d1e6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.299867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-b389f71c-4021-4baf-bbd1-a966ce359ebf req-2adfcebc-7703-4021-9258-a1f08776d1e6 service nova] Creating event network-changed:08f6804f-9163-46e0-a8a3-e6d5513b1c44 for instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 on hv-cinder-84517 Jun 15 14:56:22.304873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-b389f71c-4021-4baf-bbd1-a966ce359ebf req-2adfcebc-7703-4021-9258-a1f08776d1e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259570 Jun 15 14:56:22.305466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 44/89] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:22.310442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:22.311142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:22.318145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.318627 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.320101 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.320689 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.524095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.552601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f60cece0-004a-49fa-b3ee-7700cca27c02 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.376492 Jun 15 14:56:22.553273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 46/90] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:22 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:22.558986 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:22.559818 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:22.572064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.573413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.574372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:22.576375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:22.601184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.613211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8914e344-f0b7-4653-9984-760b8250185b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.306534 Jun 15 14:56:22.613797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 45/91] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:22 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:22.756429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:22.763739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b1cb4f33-beaa-4812-948d-526ae75527db tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.208696 Jun 15 14:56:22.764300 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 47/92] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:22 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:23.192641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:23.193546 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:23.200306 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.200758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.201529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.201965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.340106 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.349014 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.350573 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.351677 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a8ae5952-86f4-49ac-95c2-111bc8ed4980 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.163897 Jun 15 14:56:23.352230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 46/93] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:23 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:23.570277 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:23.571293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:23.578859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.579312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.580075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.580521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.631086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:23.631803 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:23.638105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.638593 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.639482 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.639994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.757416 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.764952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-24cd758b-66f2-47f1-8b2f-1ef77a822215 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.199577 Jun 15 14:56:23.765952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 48/94] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:23 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:23.782858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:23.783635 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:23.789848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.790449 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.791459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:23.791952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:23.813919 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.822615 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0ef7dd05-e210-4101-a063-b066d5f969dd tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.195803 Jun 15 14:56:23.823184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 47/95] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:23 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:23.923510 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:23.931013 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2ce1cbcf-700a-4603-ba66-e96693ac4a3d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.154153 Jun 15 14:56:23.931588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 49/96] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:23 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:24.320959 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-437f7b22-0efd-4b35-b92e-c1002061834c req-a79d7593-d8d1-41a5-9699-2c2f5e6416ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c39abd-c1c7-443f-802e-a65f0e0888ec", "tag": "d4d096f3-f841-4620-b51b-2526592f3ae0"}, {"name": "network-changed", "server_uuid": "ba5993ec-f833-475c-8ea7-16536586674d", "tag": "3ee7db41-7d40-4611-bbca-5160488232ba"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:24.330783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-437f7b22-0efd-4b35-b92e-c1002061834c req-a79d7593-d8d1-41a5-9699-2c2f5e6416ec service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.331237 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-437f7b22-0efd-4b35-b92e-c1002061834c req-a79d7593-d8d1-41a5-9699-2c2f5e6416ec service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:24.344937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-437f7b22-0efd-4b35-b92e-c1002061834c req-a79d7593-d8d1-41a5-9699-2c2f5e6416ec service nova] Creating event network-changed:d4d096f3-f841-4620-b51b-2526592f3ae0 for instance 97c39abd-c1c7-443f-802e-a65f0e0888ec on hv-cinder-84517 Jun 15 14:56:24.345441 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-437f7b22-0efd-4b35-b92e-c1002061834c req-a79d7593-d8d1-41a5-9699-2c2f5e6416ec service nova] Creating event network-changed:3ee7db41-7d40-4611-bbca-5160488232ba for instance ba5993ec-f833-475c-8ea7-16536586674d on hv-cinder-84517 Jun 15 14:56:24.351486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-437f7b22-0efd-4b35-b92e-c1002061834c req-a79d7593-d8d1-41a5-9699-2c2f5e6416ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034163 Jun 15 14:56:24.352072 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 48/97] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:24.368892 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:24.369495 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:24.376328 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.376792 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:24.377598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.378042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:24.791324 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:24.791954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:24.799484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.799932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:24.800739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:24.801170 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:25.092279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.097576 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.099120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.100233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c93448d8-013d-4a4b-b3ac-532154ec7ad5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.735429 Jun 15 14:56:25.106770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 50/98] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:24 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:25.106770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:25.106770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:25.112530 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:25.112990 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:25.113760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:25.114382 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:25.164927 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.172899 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-167289e5-0bf9-4852-a6cb-ce60c1845bed tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.386115 Jun 15 14:56:25.173472 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 49/99] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:24 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:25.199097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:25.199097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:25.215570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:25.216027 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:25.216822 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:25.217246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:25.274821 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.282397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-18668aee-84c8-4fb9-a4e3-a377fe4580a7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.180232 Jun 15 14:56:25.282959 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 51/100] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:25 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:25.359304 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:25.366818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9bc69b28-5580-4802-a24d-f2ca611daaad tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.183851 Jun 15 14:56:25.367386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:25 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:26.118008 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:26.118639 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:26.120581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=6 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:26.126149 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.126625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.127388 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.127825 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.189361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:26.190620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:26.196650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.197112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.198042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.198646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.303053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.313948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.315415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.316523 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8fb4a0ee-fb47-495b-b374-85e5436185ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.202447 Jun 15 14:56:26.317068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 52/102] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:26 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:26.321602 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:26.322367 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:26.328426 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.328872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.329804 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.330280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.358712 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.366456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e8c1b66b-eb88-4abe-891a-e022949f0c64 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.181453 Jun 15 14:56:26.367123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 51/103] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:26 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:26.384368 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:26.385010 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:26.392089 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.392535 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.393335 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:26.393768 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:26.500853 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.509099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ab9c64b1-f921-46b1-9620-484aec186ff8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.190830 Jun 15 14:56:26.509592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 53/104] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:26 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:26.546202 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:26.557729 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-860d1a2f-47a5-42a5-93b7-5d6969a633d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.177317 Jun 15 14:56:26.558369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 52/105] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:26 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:27.334416 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:27.335079 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:27.341409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.341972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.344533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.344533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.383253 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:27.383855 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:27.389908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.390397 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.391169 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.391603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.680288 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.689849 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.691489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.695060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-934c4c07-c963-42f9-8b8c-942e5f182ba3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.361957 Jun 15 14:56:27.695060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 54/106] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:27 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:27.699099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:27.699920 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:27.708794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.709451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.710312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.711053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.714578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:27.888603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:27.896686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a2ff4519-b079-41a3-a7d8-85103c898ee3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.517225 Jun 15 14:56:27.906705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 53/107] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:27 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:27.906705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:27.906705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:27.908537 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.908988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:27.909806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:27.910275 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.013709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:28.022922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bad78ac4-0501-4dc5-824b-33d6716ea43b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.327728 Jun 15 14:56:28.023495 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 55/108] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:27 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:28.066416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:28.077294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4b528d6f-3629-403f-b1e2-1393f0dfffb3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.178943 Jun 15 14:56:28.078564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 54/109] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:27 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:28.130627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-107c0121-19db-49dd-a8a9-1f9166e82521 req-b066c0d7-3ecb-4794-adf5-bb39807632d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff1fa86-018b-467f-a6cf-63db9cbba893", "name": "network-vif-plugged", "status": "completed", "tag": "f1c6c166-89bd-466b-9b18-5bb2233786d8"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:28.139169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-107c0121-19db-49dd-a8a9-1f9166e82521 req-b066c0d7-3ecb-4794-adf5-bb39807632d2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.139603 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-107c0121-19db-49dd-a8a9-1f9166e82521 req-b066c0d7-3ecb-4794-adf5-bb39807632d2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.151189 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-107c0121-19db-49dd-a8a9-1f9166e82521 req-b066c0d7-3ecb-4794-adf5-bb39807632d2 service nova] Creating event network-vif-plugged:f1c6c166-89bd-466b-9b18-5bb2233786d8 for instance aff1fa86-018b-467f-a6cf-63db9cbba893 on hv-cinder-84517 Jun 15 14:56:28.156798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-107c0121-19db-49dd-a8a9-1f9166e82521 req-b066c0d7-3ecb-4794-adf5-bb39807632d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029844 Jun 15 14:56:28.157395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 56/110] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:28.310819 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4cd1a4fb-d54b-47b0-8bc1-63e84a0150c1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad8fb8b7-1c89-4c24-b801-5c1b00c2ba39"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:28.311940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4cd1a4fb-d54b-47b0-8bc1-63e84a0150c1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:28.318178 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4cd1a4fb-d54b-47b0-8bc1-63e84a0150c1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.318652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4cd1a4fb-d54b-47b0-8bc1-63e84a0150c1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.319435 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4cd1a4fb-d54b-47b0-8bc1-63e84a0150c1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.319866 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4cd1a4fb-d54b-47b0-8bc1-63e84a0150c1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.713142 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:28.714919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:28.725673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.726224 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.727403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.727964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.867489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:28.876601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:28.878090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:28.879247 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f6e51d29-fefb-4c74-a8cb-a917e312eecc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.171289 Jun 15 14:56:28.879799 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 57/111] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:28 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:28.915736 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:28.916429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:28.922917 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.923372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:28.924194 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:28.924632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:29.059007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:29.068010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bbaa5f86-7aed-4084-b57c-b85f9edd94e8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.157558 Jun 15 14:56:29.068772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 58/112] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:28 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:29.074551 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:29.075156 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:29.091076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:29.091076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:29.091076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:29.091076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:29.266507 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:29.274252 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-400017f8-a83d-4c9f-82a7-0ea00adfcdd7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.204219 Jun 15 14:56:29.274831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 59/113] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:29 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:29.279320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:29.279911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:29.285652 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:29.286096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:29.286885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:29.287311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:29.421415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:29.435591 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3cb69513-f48e-4895-9bb0-ad235ad5fc42 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.153152 Jun 15 14:56:29.435591 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 60/114] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:29 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:29.897454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:29.898121 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:29.909317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:29.910015 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:29.911002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:29.911591 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.159009 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.167703 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.170432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.171614 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-074e2d5c-34b3-4cc8-9c78-53dd5b4c82bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.278495 Jun 15 14:56:30.172233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 61/115] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:29 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:30.183145 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:30.183999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:30.190715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.191186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.191940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.197296 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.339040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.347169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6e16bc15-72d3-4b84-b2ec-3ac1207d5b1f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.173801 Jun 15 14:56:30.347726 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 62/116] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:30 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:30.352133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:30.352771 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:30.354537 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:30.359320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.359770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.360529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.360964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.499042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.508846 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-221f6924-8d41-4374-8e10-33232856c924 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.160068 Jun 15 14:56:30.510227 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 63/117] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:30 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:30.515058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:30.515786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:30.522667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.523119 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.523894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:30.524326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:30.745947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:30.750431 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-deedc3a8-f7d5-452a-998a-4330f527ed95 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.239884 Jun 15 14:56:30.751150 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 64/118] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:30 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:30.782748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4cd1a4fb-d54b-47b0-8bc1-63e84a0150c1 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "POST /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.468103 Jun 15 14:56:30.782748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 55/119] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 14:56:28 2022] POST /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb/os-volume_attachments => generated 194 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:31.189740 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:31.190385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:31.196321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.196770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.197521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.197956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.328677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.336687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.338205 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.339293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a4824895-6a58-420b-9138-55a02e2af091 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.153461 Jun 15 14:56:31.340437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 65/120] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:31 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:31.365539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:31.366268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:31.373618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.374069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.374859 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.375289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.503758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.511364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4015e567-adcb-45d2-8b2c-3e223ea4c439 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.150531 Jun 15 14:56:31.512606 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 56/121] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:31 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:31.527823 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:31.528719 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:31.537695 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.538140 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.538928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.539366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.761675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:31.768461 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:31.769084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:31.775159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-180ea5f7-2476-4e77-89bf-1a41be93fb9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.251204 Jun 15 14:56:31.779080 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 66/122] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:31 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:31.782465 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.783147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:31.784559 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:31.785193 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.176111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-ba19af20-7ceb-4af4-8a0d-d8f940346119 req-3e9a37b6-dd75-4fb4-9273-5ca91fb10050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5993ec-f833-475c-8ea7-16536586674d", "name": "network-vif-plugged", "status": "completed", "tag": "3ee7db41-7d40-4611-bbca-5160488232ba"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:32.193210 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.197987 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-ba19af20-7ceb-4af4-8a0d-d8f940346119 req-3e9a37b6-dd75-4fb4-9273-5ca91fb10050 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.198459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-ba19af20-7ceb-4af4-8a0d-d8f940346119 req-3e9a37b6-dd75-4fb4-9273-5ca91fb10050 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.203529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fb105885-5df5-42af-8cac-9cf54be19e78 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.439157 Jun 15 14:56:32.204117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 57/123] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:31 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:32.219967 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-ba19af20-7ceb-4af4-8a0d-d8f940346119 req-3e9a37b6-dd75-4fb4-9273-5ca91fb10050 service nova] Creating event network-vif-plugged:3ee7db41-7d40-4611-bbca-5160488232ba for instance ba5993ec-f833-475c-8ea7-16536586674d on hv-cinder-84517 Jun 15 14:56:32.226376 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-ba19af20-7ceb-4af4-8a0d-d8f940346119 req-3e9a37b6-dd75-4fb4-9273-5ca91fb10050 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057062 Jun 15 14:56:32.227346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 67/124] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:32.360265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:32.366223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:32.375895 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.376420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.379403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.379403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.529779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:32.530527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:32.537085 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.537779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.538768 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.539378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.577114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.586053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.587903 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.589259 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-971f417e-1810-4c4e-9b54-5c7faa0c544e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.235330 Jun 15 14:56:32.589998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 58/125] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:32 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:32.797021 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:32.799250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:32.805505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.812636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.812636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:32.812636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:32.813789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.821262 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-136b3c67-2825-42a8-b1c5-89c22af877c2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.295795 Jun 15 14:56:32.821831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 68/126] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:32 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:32.823349 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:32.950525 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:32.955680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2cf4b6aa-42d7-4437-b99c-10ca8e095882 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.164205 Jun 15 14:56:32.956242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 59/127] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:32 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:33.220395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:33.221004 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.227096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.227569 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.228461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.228901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.367750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.375814 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cb60806f-08ba-4147-a27c-7cdd5e3af961 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.159400 Jun 15 14:56:33.376379 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 69/128] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:33 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:33.607538 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:33.608207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.615444 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.615983 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.616754 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.617192 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.767127 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.777190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.779222 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.780529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-da5cddd4-4e85-484b-9ddc-3e19c9cbf883 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.177681 Jun 15 14:56:33.781824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 60/129] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:33 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:33.837802 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:33.839760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.848220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.850240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.851409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.852032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.973788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:33.975142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:33.983022 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.983594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.984559 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:33.985396 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:33.988539 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:33.997747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-750f6754-8b92-42f9-b077-26f8cef518bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.163648 Jun 15 14:56:33.998693 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 70/130] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:33 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:34.141270 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:34.149797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-49723920-6184-4755-b29a-365eb21178ab tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.180041 Jun 15 14:56:34.150406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 61/131] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:33 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:34.252744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-4f78ea41-0038-4520-b971-50904d2d7910 req-b2f96320-357e-4b85-a632-9aa27dbd4e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6014d-9ea6-47c4-af6c-719e09d8d193", "name": "network-vif-plugged", "status": "completed", "tag": "08f6804f-9163-46e0-a8a3-e6d5513b1c44"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:34.261323 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-4f78ea41-0038-4520-b971-50904d2d7910 req-b2f96320-357e-4b85-a632-9aa27dbd4e3e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.261666 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-4f78ea41-0038-4520-b971-50904d2d7910 req-b2f96320-357e-4b85-a632-9aa27dbd4e3e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.272934 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-4f78ea41-0038-4520-b971-50904d2d7910 req-b2f96320-357e-4b85-a632-9aa27dbd4e3e service nova] Creating event network-vif-plugged:08f6804f-9163-46e0-a8a3-e6d5513b1c44 for instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 on hv-cinder-84517 Jun 15 14:56:34.278709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-4f78ea41-0038-4520-b971-50904d2d7910 req-b2f96320-357e-4b85-a632-9aa27dbd4e3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029528 Jun 15 14:56:34.281053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 71/132] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:34.392863 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:34.393780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:34.401453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.402613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.403448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.403946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.538840 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:34.546283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-088c95b6-f27c-494d-87ee-834bdf383b03 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.157485 Jun 15 14:56:34.546848 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 62/133] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:34 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:34.809254 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:34.809254 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:34.809432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.809782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.810578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:34.811008 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:34.963570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:34.975234 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:34.977460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:34.988834 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c868be91-ccdf-499a-95d7-fc18162979fb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.182638 Jun 15 14:56:34.991444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 72/134] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:34 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:35.014455 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:35.015092 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:35.018820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:35.027482 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.027830 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.028689 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.029083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.168282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:35.168962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:35.175854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.176305 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.177317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.177751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.178915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.187063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5a755c9f-4b42-45cd-9406-287fe4ee04e6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1322 microversion: 2.1 time: 0.176596 Jun 15 14:56:35.187638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 63/135] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:35 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:35.316166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.318661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:35.325452 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d50507f8-138e-4683-8c81-ba8fa320e6cc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.161160 Jun 15 14:56:35.326032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 73/136] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:35 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:35.563858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:35.564526 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:35.571094 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.571637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.572413 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:35.572833 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:35.764419 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:35.777820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-06d6715d-6dc6-4a59-9e3b-ca7a074a8f88 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.218044 Jun 15 14:56:35.779094 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 64/137] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:35 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:36.014670 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:36.015275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.021513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.021963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.022744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.023180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.158722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.167887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.169387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.170515 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-71c856eb-d757-4779-b03a-5a04445ceaaa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.159734 Jun 15 14:56:36.171065 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 74/138] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:36 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:36.203655 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:36.204266 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.211046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.211676 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.213084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.213215 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.342976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:36.343572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.347132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.350695 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.351095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.357636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.357636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.358143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e1b8572f-daa6-4747-b4f9-f9677f84cfaf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1517 microversion: 2.1 time: 0.156848 Jun 15 14:56:36.358143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 65/139] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:36 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:36.375308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:36.376674 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.383702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.388748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.388748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.388748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.423226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lazy-loading 'flavor' on Instance uuid aff1fa86-018b-467f-a6cf-63db9cbba893 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:56:36.514585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.528709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-08eb74fb-4a5f-4a96-a774-f0a876a52a76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.189386 Jun 15 14:56:36.536434 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 75/140] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:36 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:36.795752 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:36.796357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:36.805409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.805862 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.807906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:36.808363 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:36.945384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:36.953022 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-92514b1d-0468-4ee0-8282-cef2bb18394c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1364 microversion: 2.1 time: 0.161200 Jun 15 14:56:36.953590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 76/141] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:36 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:37.004764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c1213045-fd50-46b2-9863-0026a82e60f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893/action" status: 200 len: 32 microversion: 2.1 time: 0.634606 Jun 15 14:56:37.005450 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 66/142] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 14:56:36 2022] POST /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893/action => generated 32 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:56:37.025252 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:37.025944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:37.032186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.032919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.033761 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.034215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.173895 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.182410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b3b3fb95-db12-424c-aeb4-39cbe0f851f4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.161370 Jun 15 14:56:37.183381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 77/143] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:37 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:37.198161 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:37.198991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:37.208614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.209217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.210033 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.210597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.344028 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.351904 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.354143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.355432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8fcda3e1-69b5-497c-bd06-295929e85f7f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.161695 Jun 15 14:56:37.356053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 67/144] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:37 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:56:37.545083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:37.546231 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:37.553217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.553971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.554983 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.556109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.744817 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:37.753914 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-014a3e16-4bab-4c56-ab4f-f243f65fa005 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.212718 Jun 15 14:56:37.754561 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 78/145] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:37 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:37.970077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:37.970758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:37.976838 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.977336 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:37.978685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:37.979121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.027963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-5489bd46-6931-40ef-bb4d-9102a7a3cc65 req-12d7b9d4-8b40-4f90-9fd2-0dbaffd96221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c39abd-c1c7-443f-802e-a65f0e0888ec", "name": "network-vif-plugged", "status": "completed", "tag": "d4d096f3-f841-4620-b51b-2526592f3ae0"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:38.039114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-5489bd46-6931-40ef-bb4d-9102a7a3cc65 req-12d7b9d4-8b40-4f90-9fd2-0dbaffd96221 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.039828 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-5489bd46-6931-40ef-bb4d-9102a7a3cc65 req-12d7b9d4-8b40-4f90-9fd2-0dbaffd96221 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.052642 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-5489bd46-6931-40ef-bb4d-9102a7a3cc65 req-12d7b9d4-8b40-4f90-9fd2-0dbaffd96221 service nova] Creating event network-vif-plugged:d4d096f3-f841-4620-b51b-2526592f3ae0 for instance 97c39abd-c1c7-443f-802e-a65f0e0888ec on hv-cinder-84517 Jun 15 14:56:38.058650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-5489bd46-6931-40ef-bb4d-9102a7a3cc65 req-12d7b9d4-8b40-4f90-9fd2-0dbaffd96221 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034993 Jun 15 14:56:38.065174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 79/146] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:38.115213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:38.123780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-305507a4-197f-4781-92d2-44737582f45a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1554 microversion: 2.1 time: 0.157847 Jun 15 14:56:38.124733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 68/147] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:37 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:38.142203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f70a20f5-af9d-47f1-b8a9-f365af416103 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:38.142852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f70a20f5-af9d-47f1-b8a9-f365af416103 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:38.152392 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f70a20f5-af9d-47f1-b8a9-f365af416103 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.152871 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f70a20f5-af9d-47f1-b8a9-f365af416103 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.154010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f70a20f5-af9d-47f1-b8a9-f365af416103 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.160106 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f70a20f5-af9d-47f1-b8a9-f365af416103 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.200008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:38.200951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:38.207731 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.208403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.218127 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.218127 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.328709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f70a20f5-af9d-47f1-b8a9-f365af416103 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191083 Jun 15 14:56:38.329303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 80/148] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 14:56:38 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:38.382693 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:38.383790 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:38.392875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.393735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.395014 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.395711 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.420121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:38.432325 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4c31a01d-ccdf-4ee1-a7b7-06543432e898 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.236701 Jun 15 14:56:38.433068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 69/149] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:38 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:38.548631 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:38.582393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:38.589159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:38.592538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9b480276-5085-4e88-b4a6-c0b37c897f47 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1407 microversion: 2.20 time: 0.219360 Jun 15 14:56:38.596024 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 81/150] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:38 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:38.773181 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:38.774359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:38.783347 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.783801 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.784574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:38.785007 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:38.956206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:38.967096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4a3b0749-668b-40dc-bdaf-f4537f749479 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.197789 Jun 15 14:56:38.968849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 70/151] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:38 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:39.460029 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:39.461637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:39.468719 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.469618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.470610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.471099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.613008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:39.613636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:39.634604 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.634604 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.634604 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.634604 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.696913 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:39.718250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7d9daa93-a837-41fd-9d3d-c093e485d614 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.262463 Jun 15 14:56:39.718777 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 82/152] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:39 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:39.932860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:39.942787 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:39.944370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:39.946487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3b593342-4063-43bf-bfb1-95db4e2d3e75 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1599 microversion: 2.20 time: 0.337460 Jun 15 14:56:39.947357 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 71/153] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:56:39 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1599 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:56:39.966020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-af50d52b-4e3b-4a2f-9270-c421fa43c385 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:39.966637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-af50d52b-4e3b-4a2f-9270-c421fa43c385 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:39.976279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af50d52b-4e3b-4a2f-9270-c421fa43c385 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.976279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af50d52b-4e3b-4a2f-9270-c421fa43c385 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.976279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af50d52b-4e3b-4a2f-9270-c421fa43c385 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:39.976279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af50d52b-4e3b-4a2f-9270-c421fa43c385 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:39.985724 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:39.986489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:40.006881 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.007529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.009049 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.009678 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.096605 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-af50d52b-4e3b-4a2f-9270-c421fa43c385 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.135115 Jun 15 14:56:40.102277 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 83/154] 10.222.0.23 () {60 vars in 1315 bytes} [Wed Jun 15 14:56:39 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:56:40.220258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:40.252699 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0f3d1c46-9e46-44eb-86ef-9ec411215f68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.260882 Jun 15 14:56:40.252699 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 72/155] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:39 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:40.736170 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:40.738761 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:40.745712 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.746160 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.746964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.747404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.796051 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-974b1d90-8465-4a41-bc71-a8d508f716e8 req-4ba6a49b-6a52-4324-a6ac-56c050d8e78f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5993ec-f833-475c-8ea7-16536586674d", "tag": "3ee7db41-7d40-4611-bbca-5160488232ba"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:40.806789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-974b1d90-8465-4a41-bc71-a8d508f716e8 req-4ba6a49b-6a52-4324-a6ac-56c050d8e78f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:40.813344 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-974b1d90-8465-4a41-bc71-a8d508f716e8 req-4ba6a49b-6a52-4324-a6ac-56c050d8e78f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:40.821283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-974b1d90-8465-4a41-bc71-a8d508f716e8 req-4ba6a49b-6a52-4324-a6ac-56c050d8e78f service nova] Creating event network-changed:3ee7db41-7d40-4611-bbca-5160488232ba for instance ba5993ec-f833-475c-8ea7-16536586674d on hv-cinder-84517 Jun 15 14:56:40.826734 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-974b1d90-8465-4a41-bc71-a8d508f716e8 req-4ba6a49b-6a52-4324-a6ac-56c050d8e78f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035715 Jun 15 14:56:40.827758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 73/156] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:56:41.181029 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:41.194380 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-76425876-5e64-4a1f-936a-6f6e2b8aec33 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.461450 Jun 15 14:56:41.196877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 84/157] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:40 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:41.262950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:41.263873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:41.280806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.280806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.280806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:41.280806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:41.563853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:41.566219 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:41.573135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0f6d365f-b10b-4aad-b146-4acf59206f9a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.316964 Jun 15 14:56:41.574346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 74/158] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:41 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:42.213305 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:42.213914 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:42.220005 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.220466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.221334 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.221775 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.387259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:42.398548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e39785ec-b975-4dc2-8af0-ffa65f88202a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.187920 Jun 15 14:56:42.400282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 85/159] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:42 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:42.590636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:42.591544 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:42.599284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.599789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.601129 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.601965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.750048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:42.758820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e30140a6-8a88-448a-8ae3-8690c2ca37aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.172011 Jun 15 14:56:42.759373 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 75/160] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:42 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:42.854432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-145a0da0-bb49-412b-a8a7-492083445fad req-76ceab97-b202-44fc-afd7-7769d26f02c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6014d-9ea6-47c4-af6c-719e09d8d193", "tag": "08f6804f-9163-46e0-a8a3-e6d5513b1c44"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:42.888459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-145a0da0-bb49-412b-a8a7-492083445fad req-76ceab97-b202-44fc-afd7-7769d26f02c0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:42.891916 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-145a0da0-bb49-412b-a8a7-492083445fad req-76ceab97-b202-44fc-afd7-7769d26f02c0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:42.904266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-145a0da0-bb49-412b-a8a7-492083445fad req-76ceab97-b202-44fc-afd7-7769d26f02c0 service nova] Creating event network-changed:08f6804f-9163-46e0-a8a3-e6d5513b1c44 for instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 on hv-cinder-84517 Jun 15 14:56:42.911568 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-145a0da0-bb49-412b-a8a7-492083445fad req-76ceab97-b202-44fc-afd7-7769d26f02c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062140 Jun 15 14:56:42.916550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 86/161] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:43.419825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:43.420431 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:43.426502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.426954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.427710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.428267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.563520 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:43.571611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d0fe06b3-b17b-4afe-aa8b-dc3d226c9e8f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.155644 Jun 15 14:56:43.572344 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 76/162] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:43 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:43.776574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:43.777406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:43.783717 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.784729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.785118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:43.785744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:43.930394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:43.940941 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dd81a83d-48ab-40f0-aa68-30e0fb3c9f89 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.168922 Jun 15 14:56:43.950756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 87/163] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:43 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:44.589682 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:44.590462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:44.597052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:44.597503 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:44.598294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:44.606440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:44.733081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:44.740474 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f6ab2f2b-2185-4ed7-ba83-4756ad0d1050 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.154727 Jun 15 14:56:44.741072 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 77/164] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:44 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:44.957999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:44.960146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:44.971749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:44.972217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:44.976487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:44.977109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:45.123027 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:45.133321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cfe0311d-474e-41e0-9783-1468aeb1e062 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1363 microversion: 2.1 time: 0.179332 Jun 15 14:56:45.133897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 88/165] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:44 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:45.757543 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:45.758179 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:45.765387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:45.765841 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:45.766634 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:45.767073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:45.916156 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:45.924143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-be8d13ad-df3d-4464-8b94-061e35b5b815 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.171175 Jun 15 14:56:45.925083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 78/166] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:45 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:46.153669 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:46.154325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:46.160959 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.161555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:46.163112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.163871 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:46.334355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:46.342428 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-628d3c6f-8bad-4def-af7f-a478e9b74ef7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1549 microversion: 2.1 time: 0.194940 Jun 15 14:56:46.342993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 89/167] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:46 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:46.361806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-31ff905f-8576-4d4a-856b-ef57463b8a3d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:46.362400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-31ff905f-8576-4d4a-856b-ef57463b8a3d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:46.370926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-31ff905f-8576-4d4a-856b-ef57463b8a3d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.371373 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-31ff905f-8576-4d4a-856b-ef57463b8a3d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:46.372140 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-31ff905f-8576-4d4a-856b-ef57463b8a3d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.372718 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-31ff905f-8576-4d4a-856b-ef57463b8a3d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:46.461244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-31ff905f-8576-4d4a-856b-ef57463b8a3d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104318 Jun 15 14:56:46.461841 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 79/168] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 14:56:46 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:46.941038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:46.941659 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:46.948741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.949378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:46.949961 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:46.950419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:47.209067 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:47.216853 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-df441b44-0da9-4a69-94f4-ee9d679b347f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.279676 Jun 15 14:56:47.219228 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 90/169] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:46 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:48.063407 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-f48c3d38-30c8-4998-b45b-7eba81a032a4 req-2d1064d6-303d-4531-bc82-25ed4e783be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c39abd-c1c7-443f-802e-a65f0e0888ec", "tag": "d4d096f3-f841-4620-b51b-2526592f3ae0"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:48.072078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f48c3d38-30c8-4998-b45b-7eba81a032a4 req-2d1064d6-303d-4531-bc82-25ed4e783be6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:48.072526 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f48c3d38-30c8-4998-b45b-7eba81a032a4 req-2d1064d6-303d-4531-bc82-25ed4e783be6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:48.084323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-f48c3d38-30c8-4998-b45b-7eba81a032a4 req-2d1064d6-303d-4531-bc82-25ed4e783be6 service nova] Creating event network-changed:d4d096f3-f841-4620-b51b-2526592f3ae0 for instance 97c39abd-c1c7-443f-802e-a65f0e0888ec on hv-cinder-84517 Jun 15 14:56:48.089396 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-f48c3d38-30c8-4998-b45b-7eba81a032a4 req-2d1064d6-303d-4531-bc82-25ed4e783be6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030146 Jun 15 14:56:48.089985 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 80/170] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:56:48.237298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:48.238712 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:48.245929 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:48.247069 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:48.248471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:48.249626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:48.471033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:48.478760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-eebe4456-b88d-4ae6-accb-4cdefd134a6b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.247515 Jun 15 14:56:48.479412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 91/171] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:48 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:49.496814 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:49.497455 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:49.504356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:49.504921 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:49.505684 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:49.506120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:49.536842 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:49.537421 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:49.543655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:49.544183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:49.545055 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:49.545574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:49.564294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:56:49.575393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:56:49.642724 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:49.653782 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3d94c31f-7ef7-485a-968e-d53dbb11da1e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.161255 Jun 15 14:56:49.654825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 81/172] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:49 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:56:50.089164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-62c522ee-8d04-40b8-89bd-0e85ef6098fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 204 len: 0 microversion: 2.1 time: 0.556139 Jun 15 14:56:50.090276 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 92/173] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 14:56:49 2022] DELETE /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 14:56:50.098372 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:50.099310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:50.106124 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:50.107262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:50.108111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:50.108625 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:50.246744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:50.255535 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e1b8ddc3-0412-4e0f-ae93-3f229e1c0544 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1553 microversion: 2.1 time: 0.161144 Jun 15 14:56:50.256113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 82/174] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:50 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:50.673438 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:50.674136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:50.680648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:50.681105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:50.681872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:50.682353 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:50.854114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:50.861974 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-29bd60e3-432b-4531-91ff-3eff8646417f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.192816 Jun 15 14:56:50.863335 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 93/175] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:50 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:51.274437 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:51.275052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:51.281917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:51.285696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:51.285696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:51.285696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:51.420042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:51.428611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d19b8bd0-df3d-4f78-a164-2c72f8374966 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1553 microversion: 2.1 time: 0.159518 Jun 15 14:56:51.429168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 83/176] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:51 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:51.880067 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:51.880685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:51.887454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:51.887912 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:51.888671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:51.889111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:52.049328 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:52.062527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-419b2c3d-bc32-49c0-b654-e88f3855ed5f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.186396 Jun 15 14:56:52.063109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 94/177] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:51 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:52.446896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:52.446896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:52.453237 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:52.453692 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:52.454519 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:52.454953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:52.594922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:52.603420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5bc19ad1-75d8-463f-a10c-55025762c0c8 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1553 microversion: 2.1 time: 0.162114 Jun 15 14:56:52.603987 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 84/178] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:52 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:53.085118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:53.087144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:53.095029 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.102280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.102280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.102280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.316310 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:53.322627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7e633652-fdec-4baf-8b8e-27db874edfc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.246541 Jun 15 14:56:53.323198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 95/179] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:53 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:53.620804 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:53.621788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:53.628806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.629257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.645309 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.645309 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.653783 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-50448f3d-bde0-4baf-9bd6-49050c0fcf66 req-c24d9fd6-f0e1-4919-929d-ec142e213990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c67599e9-f38f-44ad-8211-3976ee2473bb", "name": "network-vif-deleted", "tag": "62e514f1-dd0d-47a1-90f8-ae167257f235"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:56:53.665144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-50448f3d-bde0-4baf-9bd6-49050c0fcf66 req-c24d9fd6-f0e1-4919-929d-ec142e213990 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:53.665582 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-50448f3d-bde0-4baf-9bd6-49050c0fcf66 req-c24d9fd6-f0e1-4919-929d-ec142e213990 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:53.678782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-50448f3d-bde0-4baf-9bd6-49050c0fcf66 req-c24d9fd6-f0e1-4919-929d-ec142e213990 service nova] Creating event network-vif-deleted:62e514f1-dd0d-47a1-90f8-ae167257f235 for instance c67599e9-f38f-44ad-8211-3976ee2473bb on hv-cinder-84517 Jun 15 14:56:53.683958 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-50448f3d-bde0-4baf-9bd6-49050c0fcf66 req-c24d9fd6-f0e1-4919-929d-ec142e213990 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033750 Jun 15 14:56:53.684733 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 96/180] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:56:53.713705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:53.722067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-215ef20f-100a-4fd9-a351-4d999fc4073e tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1511 microversion: 2.1 time: 0.105072 Jun 15 14:56:53.726224 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 85/181] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:53 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1511 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:54.339273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:54.340010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:54.346256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.346703 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.347462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.347891 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.493573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:54.504794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-676a17e6-23ae-4d20-b83c-523dea90e7ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.169751 Jun 15 14:56:54.505439 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 97/182] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:54 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:54.739438 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:54.740078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:54.746568 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.747010 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.747774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.748206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.789624 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:54.790077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:54.790556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lazy-loading 'fault' on Instance uuid c67599e9-f38f-44ad-8211-3976ee2473bb {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:56:54.837452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdf869a706a445d950ee8f59595ad4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbb7af9fb2864248800c775d2d0d174e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:54.846116 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-47ae8b3d-5a56-4879-955b-c69a4f62ee40 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 200 len: 1351 microversion: 2.1 time: 0.110751 Jun 15 14:56:54.846701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 86/183] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:54 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:55.522090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:55.523916 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:55.530782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.531620 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.532469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.533423 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.864456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:55.865072 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:55.871995 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.872442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.873211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:55.873639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:55.889337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] HTTP exception thrown: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:55.891316 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Request method failure captured: Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb HTTP/1.1 Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfLnFf7BDiUTqlJYIBwhUncYC7AQZygoFSzo8kHepoE5gjkZi0QsefYMFt430lGSAjijsUUZQnjlaxpLzUmh8MkqCA-Vjc-q5SoBnbdupuXIllTFK8Bd1D9kxUAm7K0JuwbT5p9dK6pae2VqLW3XH1nZrhwelK8ZE7aGG-FFadqTmuA Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 14:56:55.895081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 5fdf869a706a445d950ee8f59595ad4a Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:55.896416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'c67599e9-f38f-44ad-8211-3976ee2473bb'} Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:56:55.897247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:55.898556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:55.899688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Returning 404 to user: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:56:55.899688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-99a9b782-bf7e-42d8-9f9f-cceb443707cb tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 404 len: 111 microversion: 2.1 time: 0.036264 Jun 15 14:56:55.899688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 87/184] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:55 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:56:55.902897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2aa55403-e2a7-4f09-afce-637d4af41c99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.385303 Jun 15 14:56:55.903469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 98/185] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:55 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:56.022864 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:56.023837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:56.030777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.031224 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.032052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.033147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.046193 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] HTTP exception thrown: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Request method failure captured: Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb/os-volume_attachments HTTP/1.1 Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfLnFf7BDiUTqlJYIBwhUncYC7AQZygoFSzo8kHepoE5gjkZi0QsefYMFt430lGSAjijsUUZQnjlaxpLzUmh8MkqCA-Vjc-q5SoBnbdupuXIllTFK8Bd1D9kxUAm7K0JuwbT5p9dK6pae2VqLW3XH1nZrhwelK8ZE7aGG-FFadqTmuA Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 14:56:56.049506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 5fdf869a706a445d950ee8f59595ad4a Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:56.055745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'server_id': 'c67599e9-f38f-44ad-8211-3976ee2473bb'} Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:56:56.056506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:56.057504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:56.058581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Returning 404 to user: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:56:56.058581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d25bd9ae-f0af-4339-a0b6-40da93a2ab98 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032174 Jun 15 14:56:56.058581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 88/186] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 14:56:56 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:56:56.920378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:56.921314 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:56.928111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.928655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:56.930672 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:56.931121 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:57.168072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:57.178648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5095d9db-06d9-4f1c-a84b-4ab706dfeda5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.262347 Jun 15 14:56:57.180136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 99/187] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:56 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:57.708893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:57.709392 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:57.715947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.716384 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:57.717137 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.717568 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:57.731008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] HTTP exception thrown: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Request method failure captured: Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb HTTP/1.1 Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfLnFf7BDiUTqlJYIBwhUncYC7AQZygoFSzo8kHepoE5gjkZi0QsefYMFt430lGSAjijsUUZQnjlaxpLzUmh8MkqCA-Vjc-q5SoBnbdupuXIllTFK8Bd1D9kxUAm7K0JuwbT5p9dK6pae2VqLW3XH1nZrhwelK8ZE7aGG-FFadqTmuA Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 14:56:57.732432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 5fdf869a706a445d950ee8f59595ad4a Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.733915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'c67599e9-f38f-44ad-8211-3976ee2473bb'} Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:56:57.738484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.739806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.741132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Returning 404 to user: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:56:57.741132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b65e771a-151e-4ca3-929e-a3ccf2bc42fa tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 404 len: 111 microversion: 2.1 time: 0.028780 Jun 15 14:56:57.741132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 89/188] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 14:56:57 2022] DELETE /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:56:57.743206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:57.743816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] [instance: c67599e9-f38f-44ad-8211-3976ee2473bb] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:57.749905 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.755709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:57.755709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:57.755709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:57.767506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] HTTP exception thrown: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Request method failure captured: Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb HTTP/1.1 Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfLnFf7BDiUTqlJYIBwhUncYC7AQZygoFSzo8kHepoE5gjkZi0QsefYMFt430lGSAjijsUUZQnjlaxpLzUmh8MkqCA-Vjc-q5SoBnbdupuXIllTFK8Bd1D9kxUAm7K0JuwbT5p9dK6pae2VqLW3XH1nZrhwelK8ZE7aGG-FFadqTmuA Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 14:56:57.772626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dbb7af9fb2864248800c775d2d0d174e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: dbb7af9fb2864248800c775d2d0d174e Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-DeleteServersTestJSON-1106360151 Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: 5fdf869a706a445d950ee8f59595ad4a Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-DeleteServersTestJSON-1106360151-project Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.774112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'c67599e9-f38f-44ad-8211-3976ee2473bb'} Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:56:57.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. Jun 15 14:56:57.776143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:56:57.778154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] Returning 404 to user: Instance c67599e9-f38f-44ad-8211-3976ee2473bb could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:56:57.779060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c925a522-0f1d-40ac-a3d2-bd4da8c5acb0 tempest-DeleteServersTestJSON-1106360151 tempest-DeleteServersTestJSON-1106360151-project] 10.222.0.23 "GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb" status: 404 len: 111 microversion: 2.1 time: 0.039692 Jun 15 14:56:57.779707 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 100/189] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:57 2022] GET /compute/v2.1/servers/c67599e9-f38f-44ad-8211-3976ee2473bb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:56:58.199993 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:58.201715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:58.211576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:58.213358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:58.214757 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:58.215361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:58.584423 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:58.593506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d4f1ff48-7298-4710-995f-837383bf11d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.398729 Jun 15 14:56:58.596077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 90/190] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:58 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:56:59.611711 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:56:59.612385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:56:59.618723 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:59.619170 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:59.619919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:56:59.620349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:56:59.787298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:56:59.795003 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7ff57f6d-0243-42de-a779-a7580e9df03e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.187268 Jun 15 14:56:59.795596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 101/191] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:56:59 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:00.812951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:00.813990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:00.820665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:00.821115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:00.821879 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:00.822340 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:01.125958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:01.134352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b46d0e86-a1a5-49ac-b34e-f1647f367071 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.325484 Jun 15 14:57:01.135612 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 91/192] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:00 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:01.636991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5b2a58d6-316c-4891-a3a9-05d96aa8c3ad tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Action: 'create', calling method: .version_select at 0x7f693ae508b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1408346442", "metadata": {"Type": "work"}}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5b2a58d6-316c-4891-a3a9-05d96aa8c3ad tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Request method failure captured: Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 122 Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfM9ZCaXF583VzzmFNzaVdyb22e5AIvsvedvLmbIEnie1Udalkxftn0B9FvjL373tNEXpqRrHO7WtIume0E-BgBHNLbWNwbpNrmX8VRj2ItOkFm1jZstmicA1sAVAkWerBohLDPu-BMzaRbU4svK32NSdYXIvkdWXGfOMKpTeQwjFTg Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 14:57:01.650702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: d1c89c198a364b05998841b87b22c76d Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1408346442", "metadata": {"Type": "work"}}} Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: Jun 15 14:57:01.656803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1408346442', 'metadata': {'Type': 'work'}}}} Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:01.657517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:57:01.659907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:57:01.662281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 14:57:01.662281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.662281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5b2a58d6-316c-4891-a3a9-05d96aa8c3ad tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:01.662281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5b2a58d6-316c-4891-a3a9-05d96aa8c3ad tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.279110 Jun 15 14:57:01.662281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 102/193] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Jun 15 14:57:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:57:01.666062 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cdb281ad-f147-4971-bd82-bf23377db2a5 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Action: 'create', calling method: .version_select at 0x7f693a543e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1982964733", "metadata": {"Type": "work"}}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cdb281ad-f147-4971-bd82-bf23377db2a5 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Request method failure captured: Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 120 Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfM9ZCaXF583VzzmFNzaVdyb22e5AIvsvedvLmbIEnie1Udalkxftn0B9FvjL373tNEXpqRrHO7WtIume0E-BgBHNLbWNwbpNrmX8VRj2ItOkFm1jZstmicA1sAVAkWerBohLDPu-BMzaRbU4svK32NSdYXIvkdWXGfOMKpTeQwjFTg Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 14:57:01.670352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: d1c89c198a364b05998841b87b22c76d Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1982964733", "metadata": {"Type": "work"}}} Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: Jun 15 14:57:01.672640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1982964733', 'metadata': {'Type': 'work'}}}} Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi '0' Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:01.673489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:57:01.674991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:57:01.676135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 14:57:01.676135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.676135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cdb281ad-f147-4971-bd82-bf23377db2a5 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:01.676135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-cdb281ad-f147-4971-bd82-bf23377db2a5 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008716 Jun 15 14:57:01.678267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 92/194] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Jun 15 14:57:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:57:01.681588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ce31e970-f1d4-47f4-94a9-b700487c93fc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Action: 'create', calling method: .version_select at 0x7f693ae6db80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-294471571", "metadata": {"Type": "work"}}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ce31e970-f1d4-47f4-94a9-b700487c93fc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Request method failure captured: Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 118 Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfM9ZCaXF583VzzmFNzaVdyb22e5AIvsvedvLmbIEnie1Udalkxftn0B9FvjL373tNEXpqRrHO7WtIume0E-BgBHNLbWNwbpNrmX8VRj2ItOkFm1jZstmicA1sAVAkWerBohLDPu-BMzaRbU4svK32NSdYXIvkdWXGfOMKpTeQwjFTg Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 14:57:01.683852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: d1c89c198a364b05998841b87b22c76d Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-294471571", "metadata": {"Type": "work"}}} Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: Jun 15 14:57:01.685244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-294471571', 'metadata': {'Type': 'work'}}}} Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise error Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi '' Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:01.686098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 14:57:01.688679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 14:57:01.689638 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 14:57:01.689638 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.689638 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ce31e970-f1d4-47f4-94a9-b700487c93fc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:01.689638 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ce31e970-f1d4-47f4-94a9-b700487c93fc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008219 Jun 15 14:57:01.690623 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 103/195] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Jun 15 14:57:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 14:57:01.695890 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7b8b3eef-41a4-4713-bb89-f82c29694036 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Calling method '.version_select at 0x7f693a76c940>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:01.795079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-7b8b3eef-41a4-4713-bb89-f82c29694036 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] HTTP exception thrown: Volume tempest-invalid-1428983479 could not be found. Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7b8b3eef-41a4-4713-bb89-f82c29694036 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Request method failure captured: Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1428983479 HTTP/1.1 Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfM9ZCaXF583VzzmFNzaVdyb22e5AIvsvedvLmbIEnie1Udalkxftn0B9FvjL373tNEXpqRrHO7WtIume0E-BgBHNLbWNwbpNrmX8VRj2ItOkFm1jZstmicA1sAVAkWerBohLDPu-BMzaRbU4svK32NSdYXIvkdWXGfOMKpTeQwjFTg Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 14:57:01.797316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: d1c89c198a364b05998841b87b22c76d Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Volume tempest-invalid-1428983479 could not be found. Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'tempest-invalid-1428983479'} Jun 15 14:57:01.798764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1428983479 could not be found. (HTTP 404) (Request-ID: req-1356d7ed-a630-4f25-ad73-df9f7932bbb1) Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.799818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:57:01.801271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1428983479 could not be found. Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:57:01.802860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1428983479 could not be found. Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1428983479 could not be found. Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7b8b3eef-41a4-4713-bb89-f82c29694036 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Returning 404 to user: Volume tempest-invalid-1428983479 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7b8b3eef-41a4-4713-bb89-f82c29694036 tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1428983479" status: 404 len: 99 microversion: 2.1 time: 0.107035 Jun 15 14:57:01.804527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 93/196] 10.222.0.23 () {58 vars in 1217 bytes} [Wed Jun 15 14:57:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1428983479 => generated 99 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 15 14:57:01.815191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-abc70856-585d-42e1-84d4-75fc3c98815e tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004810 Jun 15 14:57:01.815191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 104/197] 10.222.0.23 () {58 vars in 1139 bytes} [Wed Jun 15 14:57:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 14:57:01.821136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1ff94c50-d9fa-4c7f-848e-bf30fdc47c1b tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004417 Jun 15 14:57:01.821851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 94/198] 10.222.0.23 () {58 vars in 1136 bytes} [Wed Jun 15 14:57:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 14:57:01.830740 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c8177083-438e-4b4a-a4bd-2ae4a837973f tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Calling method '.version_select at 0x7f693ae50790>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:01.880096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-c8177083-438e-4b4a-a4bd-2ae4a837973f tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] HTTP exception thrown: Volume 95cfb13b-33a8-407d-8af8-477ce1eb2d2d could not be found. Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c8177083-438e-4b4a-a4bd-2ae4a837973f tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Request method failure captured: Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: DELETE /compute/v2.1/os-volumes/95cfb13b-33a8-407d-8af8-477ce1eb2d2d HTTP/1.1 Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfM9ZCaXF583VzzmFNzaVdyb22e5AIvsvedvLmbIEnie1Udalkxftn0B9FvjL373tNEXpqRrHO7WtIume0E-BgBHNLbWNwbpNrmX8VRj2ItOkFm1jZstmicA1sAVAkWerBohLDPu-BMzaRbU4svK32NSdYXIvkdWXGfOMKpTeQwjFTg Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 14:57:01.884293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: d1c89c198a364b05998841b87b22c76d Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Volume 95cfb13b-33a8-407d-8af8-477ce1eb2d2d could not be found. Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '95cfb13b-33a8-407d-8af8-477ce1eb2d2d'} Jun 15 14:57:01.885743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95cfb13b-33a8-407d-8af8-477ce1eb2d2d could not be found. (HTTP 404) (Request-ID: req-4af3a1c9-e94f-4703-b36e-f1d57edf92b7) Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.886735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 14:57:01.887747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95cfb13b-33a8-407d-8af8-477ce1eb2d2d could not be found. Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 14:57:01.888793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95cfb13b-33a8-407d-8af8-477ce1eb2d2d could not be found. Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95cfb13b-33a8-407d-8af8-477ce1eb2d2d could not be found. Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c8177083-438e-4b4a-a4bd-2ae4a837973f tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Returning 404 to user: Volume 95cfb13b-33a8-407d-8af8-477ce1eb2d2d could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c8177083-438e-4b4a-a4bd-2ae4a837973f tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/95cfb13b-33a8-407d-8af8-477ce1eb2d2d" status: 404 len: 109 microversion: 2.1 time: 0.058901 Jun 15 14:57:01.890950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 105/199] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 14:57:01 2022] DELETE /compute/v2.1/os-volumes/95cfb13b-33a8-407d-8af8-477ce1eb2d2d => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:57:01.896026 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a292918d-4e31-4ccd-925f-db9c32d65efc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Calling method '.version_select at 0x7f693a63dd30>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:01.931616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-a292918d-4e31-4ccd-925f-db9c32d65efc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] HTTP exception thrown: Volume d6a43946-4bf8-4a67-a255-738876428157 could not be found. Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a292918d-4e31-4ccd-925f-db9c32d65efc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Request method failure captured: Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/os-volumes/d6a43946-4bf8-4a67-a255-738876428157 HTTP/1.1 Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfM9ZCaXF583VzzmFNzaVdyb22e5AIvsvedvLmbIEnie1Udalkxftn0B9FvjL373tNEXpqRrHO7WtIume0E-BgBHNLbWNwbpNrmX8VRj2ItOkFm1jZstmicA1sAVAkWerBohLDPu-BMzaRbU4svK32NSdYXIvkdWXGfOMKpTeQwjFTg Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 14:57:01.933580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b79e365a60bf4723adf5ef861272ff48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: b79e365a60bf4723adf5ef861272ff48 Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-VolumesNegativeTest-1012522916 Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: d1c89c198a364b05998841b87b22c76d Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-VolumesNegativeTest-1012522916-project Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Volume d6a43946-4bf8-4a67-a255-738876428157 could not be found. Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'd6a43946-4bf8-4a67-a255-738876428157'} Jun 15 14:57:01.939669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6a43946-4bf8-4a67-a255-738876428157 could not be found. (HTTP 404) (Request-ID: req-8500dbf7-8b55-488c-ac48-5c16d410fbe8) Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.940443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 14:57:01.941637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6a43946-4bf8-4a67-a255-738876428157 could not be found. Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 14:57:01.942871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6a43946-4bf8-4a67-a255-738876428157 could not be found. Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6a43946-4bf8-4a67-a255-738876428157 could not be found. Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a292918d-4e31-4ccd-925f-db9c32d65efc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] Returning 404 to user: Volume d6a43946-4bf8-4a67-a255-738876428157 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a292918d-4e31-4ccd-925f-db9c32d65efc tempest-VolumesNegativeTest-1012522916 tempest-VolumesNegativeTest-1012522916-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d6a43946-4bf8-4a67-a255-738876428157" status: 404 len: 109 microversion: 2.1 time: 0.043806 Jun 15 14:57:01.944153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 95/200] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 14:57:01 2022] GET /compute/v2.1/os-volumes/d6a43946-4bf8-4a67-a255-738876428157 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:57:02.158633 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:02.159186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:02.161471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:02.167036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:02.167485 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:02.168432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:02.168868 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:02.316406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:02.324719 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4624225c-b33a-49d4-a970-9cb553dde927 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.174144 Jun 15 14:57:02.335184 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 106/201] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:02 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:03.344714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:03.345458 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:03.353386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:03.353818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:03.354617 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:03.355088 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:03.492508 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:03.500803 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-07aec6ce-21da-4b29-8815-c02db03bba69 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.161843 Jun 15 14:57:03.501361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 96/202] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:03 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:04.519996 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:04.520631 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:04.527501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:04.527953 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:04.528729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:04.529759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:04.672676 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:04.680480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-912b2324-7dce-42ae-95af-65dd489a9031 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.164367 Jun 15 14:57:04.681035 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 107/203] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:04 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:05.698023 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:05.705248 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:05.705420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:05.705870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:05.706694 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:05.707171 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:05.836215 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:05.844702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-87a49993-21e8-41d0-8eca-2c8918e0c96c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.150819 Jun 15 14:57:05.845261 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 97/204] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:05 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:06.861941 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:06.862600 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:06.868820 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:06.869275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:06.870039 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:06.870519 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:07.013530 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:07.021536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0e1da1ff-8494-43e0-b09f-093b11a548fd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.163833 Jun 15 14:57:07.022101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 108/205] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:06 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:08.045901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:08.045901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:08.046798 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=63 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:08.048714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:08.049166 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:08.049947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:08.050460 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:08.055611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:08.206677 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:08.221837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f4fe7ca3-cbac-4c6d-8212-fbe88933fda7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.186432 Jun 15 14:57:08.235130 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 98/206] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:08 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:09.242267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:09.242817 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:09.249502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:09.250012 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:09.250962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:09.251394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:09.443466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:09.453096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-041c91b0-b7d7-4a9e-a4f9-ffaaf6c941e1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.214649 Jun 15 14:57:09.453934 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 109/207] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:09 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:10.472592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:10.473191 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:10.480875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:10.481517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:10.482277 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:10.482713 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:10.632138 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:10.640433 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-74f67a6e-7dd7-48ca-93cb-34f65ee20393 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.172285 Jun 15 14:57:10.641004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 99/208] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:10 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:11.657658 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:11.658302 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:11.664397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:11.672756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:11.672756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:11.672756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:11.800153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:11.807747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f5b44672-8632-4e90-a61f-98514906f53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.153910 Jun 15 14:57:11.808450 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 110/209] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:11 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:12.825288 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:12.825895 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:12.832500 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:12.832936 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:12.833694 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:12.834126 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:12.965686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:12.973227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d85d41e1-e0f2-4816-bff2-24ce72d05ab6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.152424 Jun 15 14:57:12.973787 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:12 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:13.991028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:13.991555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:13.999019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:13.999463 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:14.000220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:14.000692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:14.136318 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:14.143822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-226eb813-754b-4361-af59-428b3d798cca tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.156811 Jun 15 14:57:14.144388 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 111/211] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:13 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:15.160845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:15.161531 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:15.168873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:15.169321 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:15.170081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:15.170546 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:15.308939 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:15.316409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b7f7c007-5035-451a-b441-1726ce407f95 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.159492 Jun 15 14:57:15.316967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 101/212] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:15 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:16.338403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:16.339007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:16.345355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:16.345828 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:16.346626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:16.347056 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:16.479349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:16.481483 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:16.487303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-24d54342-c3a2-4600-822b-28bdacca9bf6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.153265 Jun 15 14:57:16.487853 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 112/213] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:16 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:17.505210 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:17.505835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:17.512586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:17.514988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:17.514988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:17.514988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:17.645573 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:17.654607 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f357264c-70ff-43db-a6b2-40b3869b3def tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.153470 Jun 15 14:57:17.661072 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 102/214] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:17 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:18.672220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:18.672943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:18.679798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:18.680630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:18.681447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:18.681886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:18.820754 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:18.838613 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2015bac0-a5b2-4f2f-b762-9d7823382e9a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.160973 Jun 15 14:57:18.838613 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 113/215] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:18 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:19.844876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:19.845400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:19.852755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:19.852916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:19.853650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:19.854084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:20.026568 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:20.034236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c1c23443-4e24-42a1-a67f-22e7cff6c76e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.193310 Jun 15 14:57:20.034797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 103/216] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:19 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:21.052292 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:21.054062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:21.060949 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:21.061421 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:21.062412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:21.062844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:21.211409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:21.220701 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-43484078-2c23-4557-8ea5-5c8d4022206c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1523 microversion: 2.1 time: 0.173093 Jun 15 14:57:21.221513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 114/217] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:21 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:22.237669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:22.238406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:22.245806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:22.246305 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:22.247068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:22.247501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:22.424618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:22.432466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d2d2aa4d-531e-40f5-8ac9-502987546a51 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1503 microversion: 2.1 time: 0.198567 Jun 15 14:57:22.433044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 104/218] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:22 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:22.449042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:22.449700 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:22.456016 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:22.456465 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:22.457616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:22.458050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:22.614473 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:22.622847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f5c0424a-05c6-4bfd-be30-701586b87bc0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1517 microversion: 2.1 time: 0.178457 Jun 15 14:57:22.623413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 115/219] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:22 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:25.228371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1294862634", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:25.282462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] validate_networks() for None {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:57:25.574112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:57:25.574917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:57:25.576006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:57:25.577326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:57:25.578425 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:57:25.587936 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:25.588389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:25.589198 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:25.589641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:25.607582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Getting quotas for project 22a6143a5b05471e8aed517230f734e7. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:57:25.612700 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Getting quotas for user 8a74a23b13e24616921c55bc6226216f and project 22a6143a5b05471e8aed517230f734e7. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:57:25.628424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:57:25.632558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:57:25.664061 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:25.665074 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:25.673865 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:25.674379 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:25.675153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:25.675590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:25.701273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lazy-loading 'flavor' on Instance uuid 6fbdc341-c8d4-435d-a52c-9e4387a70cfc {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:57:25.923710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a283b2f6-8934-496b-aba3-32f094da14b8 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699815 Jun 15 14:57:25.925018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 105/220] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:57:25.936174 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ba53b29d-f465-4330-923f-3c8c0f93ba3e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:25.937020 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ba53b29d-f465-4330-923f-3c8c0f93ba3e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:25.999311 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ba53b29d-f465-4330-923f-3c8c0f93ba3e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:26.006290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ba53b29d-f465-4330-923f-3c8c0f93ba3e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1215 microversion: 2.1 time: 0.073989 Jun 15 14:57:26.007730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 106/221] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:25 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:26.194403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-063b9475-7a63-4aec-b1e0-6ae1bbf361b0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc/action" status: 200 len: 32 microversion: 2.1 time: 0.534881 Jun 15 14:57:26.195019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 116/222] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 14:57:25 2022] POST /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc/action => generated 32 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 14:57:26.203912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:26.204518 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:26.211709 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:26.212153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:26.212913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:26.213352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:26.351886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:26.359457 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2f7799a7-df03-4772-9210-15b554d3de19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.159338 Jun 15 14:57:26.360039 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 107/223] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:26 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:27.023590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b9ae11b7-2bee-4a3c-9a72-f416b2bd6531 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:27.024292 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b9ae11b7-2bee-4a3c-9a72-f416b2bd6531 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:27.083486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b9ae11b7-2bee-4a3c-9a72-f416b2bd6531 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:27.091083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b9ae11b7-2bee-4a3c-9a72-f416b2bd6531 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1215 microversion: 2.1 time: 0.072197 Jun 15 14:57:27.091770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 117/224] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:27 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:27.378700 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:27.379228 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:27.386455 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:27.386914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:27.387666 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:27.388098 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:27.524407 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:27.532042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6caa701e-ae08-40b0-abb8-dc9a7fe7318b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.157558 Jun 15 14:57:27.532614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 108/225] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:27 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:27.898468 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1609405693", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "networks": [{"uuid": "12f1a50d-27b9-4151-9ccf-726bf161f3d8"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:27.952584 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] validate_networks() for [('12f1a50d-27b9-4151-9ccf-726bf161f3d8', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:57:28.109025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:28.109632 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:28.116471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.116915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.117683 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.118119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.204120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:28.213372 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9c0267c9-723a-47f5-9777-fd8af15b323e tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1219 microversion: 2.1 time: 0.108219 Jun 15 14:57:28.213961 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 109/226] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:28 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:28.320378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:57:28.320830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:57:28.321252 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:57:28.321684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:57:28.322088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:57:28.331530 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.331973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.332753 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.333179 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.350109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Getting quotas for project 421ba5fd9c9d4ea0b3b3dd89069aabb2. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:57:28.353986 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Getting quotas for user 4e9c4ff3d13d4332837f519214b9df37 and project 421ba5fd9c9d4ea0b3b3dd89069aabb2. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:57:28.365477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:57:28.367874 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:57:28.548974 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:28.549647 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:28.556080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.565592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.565592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:28.565592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:28.565921 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c9f2c7ce-b033-4d93-96f2-c6a02f49d019 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668870 Jun 15 14:57:28.565921 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 118/227] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:57:28.574558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cce75f0b-d808-4f1e-b5d9-1a545bd17c58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:28.575091 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cce75f0b-d808-4f1e-b5d9-1a545bd17c58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:28.654699 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cce75f0b-d808-4f1e-b5d9-1a545bd17c58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:28.669180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cce75f0b-d808-4f1e-b5d9-1a545bd17c58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1219 microversion: 2.1 time: 0.098589 Jun 15 14:57:28.670210 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 119/228] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:28 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:28.723038 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:28.730938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7b321c36-234a-4929-a61d-9b31d4dac8df tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.185834 Jun 15 14:57:28.731626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 110/229] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:28 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:29.232247 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:29.232856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:29.239110 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:29.240190 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:29.241026 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:29.241464 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:29.302439 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:29.310221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1f2f248f-8d04-4cf4-9a3a-75e03ab3fcf6 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1211 microversion: 2.1 time: 0.081766 Jun 15 14:57:29.310795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 120/230] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:29 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:29.686590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a0a1fd3c-2a94-4052-a7c4-62a15b87f4f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:29.687202 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a0a1fd3c-2a94-4052-a7c4-62a15b87f4f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:29.740596 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a0a1fd3c-2a94-4052-a7c4-62a15b87f4f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:29.745400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a0a1fd3c-2a94-4052-a7c4-62a15b87f4f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1219 microversion: 2.1 time: 0.062573 Jun 15 14:57:29.745955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 111/231] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:29 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:29.748915 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:29.749565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:29.756789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:29.757242 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:29.758004 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:29.758469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:29.887661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:29.895177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ec87448b-5f57-4d49-834a-2dc4c8b31e4b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.150278 Jun 15 14:57:29.896355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 121/232] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:29 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:30.327236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:30.328113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:30.335086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:30.335625 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:30.336409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:30.336851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:30.401340 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:30.408882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d23c03fd-853b-473f-bfa8-5c72ba0553e3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1211 microversion: 2.1 time: 0.085581 Jun 15 14:57:30.409442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 112/233] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:30 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:30.762483 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:30.763088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:30.769087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:30.769535 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:30.770885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:30.771312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:30.830998 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:30.839006 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-530f2dd0-b2ef-425b-8a67-e0f588a0b30b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1223 microversion: 2.1 time: 0.080622 Jun 15 14:57:30.839506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 122/234] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:30 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:30.914408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:30.915019 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:30.921536 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:30.921993 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:30.922876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:30.923315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:31.049558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:31.057815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-88c8c023-3e80-4c6d-bd55-fb52740ec7f1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.147929 Jun 15 14:57:31.059238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 113/235] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:30 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:31.426677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:31.427286 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:31.433367 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:31.433817 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:31.434612 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:31.435053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:31.503691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:31.511866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e976d7d4-4210-4627-a4b4-cd97eea3ce36 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1267 microversion: 2.1 time: 0.089025 Jun 15 14:57:31.512432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 123/236] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:31 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:31.855501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:31.856097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:31.862450 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:31.862905 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:31.864172 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:31.864611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:31.937614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:31.945405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-09507a6f-7112-43f5-a5f4-5bed36e40456 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1215 microversion: 2.1 time: 0.093692 Jun 15 14:57:31.953114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 114/237] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:31 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:32.075431 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:32.075943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:32.081904 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.082465 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:32.084516 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.085085 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:32.219913 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:32.228217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6581a83a-9e42-4e98-b20a-92f12de068f3 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.156720 Jun 15 14:57:32.228927 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 124/238] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:32 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:32.528553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:32.529164 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:32.536300 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.536840 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:32.537614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.538055 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:32.600386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:32.609298 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-86ab4ec6-24d7-49e0-82ec-7b9343c1dfa0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1275 microversion: 2.1 time: 0.084583 Jun 15 14:57:32.609866 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 115/239] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:32 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:32.963680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:32.964434 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:32.970700 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.971153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:32.971925 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:32.972397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:33.242247 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:33.248295 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:33.258994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:33.259267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-486fb654-9068-44b2-a776-41bbc08d8fe3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1271 microversion: 2.1 time: 0.291709 Jun 15 14:57:33.260400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:33.260400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:33.260400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:33.261438 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:33.261583 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 125/240] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:32 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:33.525259 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:33.538941 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-89cef920-0ff8-4d57-98f1-c348b2626d3d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.297401 Jun 15 14:57:33.539723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 116/241] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:33 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:33.627279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:33.627804 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:33.634942 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:33.635390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:33.636163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:33.636648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:33.701626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:33.709966 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cabb29e2-6721-4529-9def-96ab059014e1 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1273 microversion: 2.1 time: 0.087149 Jun 15 14:57:33.710542 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 126/242] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:33 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:34.268480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:34.269144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:34.277501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.277952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.278757 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.279191 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.295885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:34.343310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:34.351326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a931ec94-988c-4ac2-aefc-5e1a52069108 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1277 microversion: 2.1 time: 0.086782 Jun 15 14:57:34.351895 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 117/243] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:34 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:34.561807 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:34.563113 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:34.571700 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.575249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.575249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.575249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.732346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:34.741261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0c3a8809-e11a-4bd5-8a27-052d2ebb2b75 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.185746 Jun 15 14:57:34.741831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 127/244] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:34 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:34.742719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:34.743339 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:34.749891 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.750375 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.751185 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:34.751566 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:34.893533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:34.898565 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2a64f812-ef2d-4244-8638-59cf122d1549 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.160841 Jun 15 14:57:34.899132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 118/245] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:34 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:35.368294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:35.368819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:35.375131 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.375575 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:35.376328 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.376760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:35.513292 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:35.521401 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cd5bc750-2704-472c-bfb0-ba41c30d6a41 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.157003 Jun 15 14:57:35.522007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 128/246] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:35 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:35.758631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:35.759247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:35.761559 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:35.766464 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.766916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:35.767730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.768169 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:35.899402 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:35.907142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-67e572e1-e935-45f7-8032-8ceb9422a49e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.152438 Jun 15 14:57:35.907707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 119/247] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:35 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:35.916438 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:35.917118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:35.923269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.923713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:35.924462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:35.925154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:36.061317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:36.069486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-55508978-8bea-4ef9-9747-39d61d73b1cd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.156934 Jun 15 14:57:36.070050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 129/248] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:35 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:36.537515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:36.538125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:36.544308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:36.544759 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:36.545515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:36.545951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:36.675552 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:36.683085 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a93cd266-ed90-455e-952c-57270e028207 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.149397 Jun 15 14:57:36.683678 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 120/249] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:36 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:36.925005 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:36.925869 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:36.927735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:36.932446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:36.932891 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:36.933654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:36.934087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:36.936587 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:37.067726 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:37.078055 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-862ee38d-66dd-44d5-9306-ed328b8a4a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.157343 Jun 15 14:57:37.078715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 130/250] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:36 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:37.090298 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:37.090834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:37.098117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:37.098587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:37.099364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:37.099796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:37.228085 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:37.235517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ad21cd49-2f7b-4094-808b-e98d79eae1c4 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.149247 Jun 15 14:57:37.236076 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 121/251] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:37 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:37.700944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:37.701565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:37.709855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:37.710336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:37.711122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:37.711560 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:37.976293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:37.984593 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0a0b5e9e-c42b-497b-9f3a-616211af8965 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.287562 Jun 15 14:57:37.985182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 131/252] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:37 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:38.095812 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:38.096484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:38.104458 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:38.105180 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:38.108434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:38.108434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:38.255677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:38.256808 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:38.264209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:38.264667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:38.265649 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:38.266271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:38.341250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:38.441823 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:38.450371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-74b78a8c-057f-4299-9318-a309f517b89a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.358525 Jun 15 14:57:38.451285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 122/253] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:38 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:38.612974 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:38.620570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-195aa31f-df7e-4a10-8a0e-e73627e8f6a3 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.368832 Jun 15 14:57:38.621247 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 132/254] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:38 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:39.003419 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:39.004269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:39.011370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:39.011829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:39.012616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:39.013078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:39.272132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:39.279675 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d7839d93-7ba2-46cd-8ba3-37dc79b6b85b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.282320 Jun 15 14:57:39.280236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 123/255] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:38 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:39.473665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:39.475051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:39.478600 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=10 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:39.484154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:39.484636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:39.485413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:39.485850 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:39.545213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-0a2cab0f-900a-4c35-aa81-bb2fbb84f8aa req-86a8b144-79d9-43a4-b0a2-e02c3105dbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd8ef1d-c5d2-429c-839b-cb3e236bbb17", "tag": "c95a6e62-c8ac-4e01-b99e-c17859e54779"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:39.545213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-0a2cab0f-900a-4c35-aa81-bb2fbb84f8aa req-86a8b144-79d9-43a4-b0a2-e02c3105dbc0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:39.545213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-0a2cab0f-900a-4c35-aa81-bb2fbb84f8aa req-86a8b144-79d9-43a4-b0a2-e02c3105dbc0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:39.545213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-0a2cab0f-900a-4c35-aa81-bb2fbb84f8aa req-86a8b144-79d9-43a4-b0a2-e02c3105dbc0 service nova] Creating event network-changed:c95a6e62-c8ac-4e01-b99e-c17859e54779 for instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 on hv-cinder-84517 Jun 15 14:57:39.553184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-0a2cab0f-900a-4c35-aa81-bb2fbb84f8aa req-86a8b144-79d9-43a4-b0a2-e02c3105dbc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037248 Jun 15 14:57:39.554048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 124/256] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:57:39.642565 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:39.648966 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:39.651315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:39.651780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:39.652611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:39.653398 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:39.717369 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:39.742919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-be26cde2-4ca6-4e01-a67c-963c97e41740 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.277966 Jun 15 14:57:39.743660 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 133/257] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:39 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:39.744356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=10 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:39.960580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:39.968277 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e37bf7a9-9a5e-45ad-a40a-81289165e68b tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.331661 Jun 15 14:57:39.968925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:39 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:40.297057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:40.297665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:40.305241 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.305836 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:40.306578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.307658 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:40.570893 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:40.581072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f0766b0f-1507-4b43-b348-f6c7d1adb8ee tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.287922 Jun 15 14:57:40.582485 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 134/259] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:40 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:40.761125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:40.761731 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:40.764056 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:40.769026 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.769445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:40.770234 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.770671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:40.967247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:40.975548 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fa5d557f-2a29-46a7-aa8f-9fb7cf3c9926 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.218630 Jun 15 14:57:40.976104 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 126/260] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:40 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:40.985018 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:40.985786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:40.992576 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.993019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:40.993772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:40.994302 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:41.125683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:41.133135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ff340d2b-a095-4b99-817d-8792d965372c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.152166 Jun 15 14:57:41.133690 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 135/261] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:40 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:41.570695 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-d03514a6-05d8-4511-9253-1098b7bd547d req-e3773f27-0aff-4231-b179-0e48e27c4801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd87633-dc29-4c78-851a-a052d758173d", "tag": "82ecae61-5294-40dd-ae1f-4c5a9700436b"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:41.578633 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d03514a6-05d8-4511-9253-1098b7bd547d req-e3773f27-0aff-4231-b179-0e48e27c4801 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:41.579075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d03514a6-05d8-4511-9253-1098b7bd547d req-e3773f27-0aff-4231-b179-0e48e27c4801 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:41.590198 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-d03514a6-05d8-4511-9253-1098b7bd547d req-e3773f27-0aff-4231-b179-0e48e27c4801 service nova] Creating event network-changed:82ecae61-5294-40dd-ae1f-4c5a9700436b for instance acd87633-dc29-4c78-851a-a052d758173d on hv-cinder-84517 Jun 15 14:57:41.596203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-d03514a6-05d8-4511-9253-1098b7bd547d req-e3773f27-0aff-4231-b179-0e48e27c4801 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028000 Jun 15 14:57:41.596203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 127/262] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:41.598847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:41.600011 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:41.606739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:41.607245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:41.607979 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:41.608414 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:41.737929 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:41.745724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a5c74e1d-8143-4a6e-9d24-91b6ec7ad025 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.150726 Jun 15 14:57:41.747628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 136/263] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:41 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:41.993524 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:41.994150 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:42.000937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.001832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.002623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.005207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.144114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:42.150015 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:42.150728 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:42.152157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e6a923a5-492f-42f6-8334-ef398a1017c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.163306 Jun 15 14:57:42.152755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:41 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:42.156984 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.157441 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.158324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.158782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.426146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:42.433808 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f5be2f25-1630-4c39-8336-36ee197157b0 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.287508 Jun 15 14:57:42.434609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 137/265] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:42 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:42.762881 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:42.763497 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:42.770345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.770797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.771560 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:42.771994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:42.902972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:42.911224 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e6d79130-336f-4980-ba44-f22612f5c9f0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.152255 Jun 15 14:57:42.911784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 129/266] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:42 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:43.169083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:43.169598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:43.176413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.176860 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:43.177627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.178075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:43.307412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:43.315078 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-141a747a-d619-406a-951d-12bb1ad2ed10 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.149952 Jun 15 14:57:43.315641 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 138/267] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:43 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:43.451623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:43.452237 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:43.459494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.459943 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:43.460705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.461141 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:43.593564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:43.601619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-197fdbf6-617a-42d4-a12c-eee81d4857a5 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.153974 Jun 15 14:57:43.602193 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 130/268] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:43 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:43.928689 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:43.929296 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:43.935366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.935818 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:43.936697 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:43.937138 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:44.143894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:44.154405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f124ccbe-9e9f-48d4-b94a-756306ecd3d3 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.229417 Jun 15 14:57:44.167226 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 139/269] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:43 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:44.332554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:44.333160 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:44.339640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:44.339979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:44.340957 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:44.341595 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:44.506707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:44.514466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a0e66fde-d993-4231-b7ad-aa2cb9db8599 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.186546 Jun 15 14:57:44.515022 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 131/270] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:44 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:44.619513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:44.620212 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:44.627356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:44.627807 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:44.628581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:44.629049 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:44.767254 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:44.774624 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c08d3182-30e0-4181-9895-b502442413ee tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.159026 Jun 15 14:57:44.775524 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 140/271] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:44 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:45.172567 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:45.173175 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:45.179277 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.179772 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.180532 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.181029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.308339 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:45.315886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f9f5a8f0-780d-4770-8d21-b3f6302b9df0 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.147256 Jun 15 14:57:45.316447 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 132/272] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:45 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:45.532399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:45.533164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:45.542312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.545424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.545424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.545424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.682562 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:45.690793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5877e121-a1d2-426f-8ee3-cb129823f455 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.162649 Jun 15 14:57:45.691359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 141/273] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:45 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:45.792353 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:45.792959 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:45.800096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.800542 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.801303 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:45.801736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:45.945471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:45.954772 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-148068c9-6b4a-4b8c-905a-fc5621427342 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.166212 Jun 15 14:57:45.955356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 133/274] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:45 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:46.333278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:46.333885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:46.340599 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.341193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.341959 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.342447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.481611 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:46.490691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5d8c9235-a36d-406b-a5dd-ab44ad22112c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.161795 Jun 15 14:57:46.491335 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 142/275] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:46 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:46.498189 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-74a75b8f-101b-43b6-b86b-30b2083f10c6 req-d983112b-fb8a-46d5-9b78-b231953d8f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd87633-dc29-4c78-851a-a052d758173d", "name": "network-vif-plugged", "status": "completed", "tag": "82ecae61-5294-40dd-ae1f-4c5a9700436b"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:46.507869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-74a75b8f-101b-43b6-b86b-30b2083f10c6 req-d983112b-fb8a-46d5-9b78-b231953d8f62 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.508306 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-74a75b8f-101b-43b6-b86b-30b2083f10c6 req-d983112b-fb8a-46d5-9b78-b231953d8f62 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.520017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-74a75b8f-101b-43b6-b86b-30b2083f10c6 req-d983112b-fb8a-46d5-9b78-b231953d8f62 service nova] Creating event network-vif-plugged:82ecae61-5294-40dd-ae1f-4c5a9700436b for instance acd87633-dc29-4c78-851a-a052d758173d on hv-cinder-84517 Jun 15 14:57:46.524904 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-74a75b8f-101b-43b6-b86b-30b2083f10c6 req-d983112b-fb8a-46d5-9b78-b231953d8f62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030580 Jun 15 14:57:46.525492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 134/276] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:57:46.721415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:46.721415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:46.721415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.721415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.722235 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.722235 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.846506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:46.853954 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6bc2f7c1-1cc5-49ac-bf41-42f4da6c153a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.151175 Jun 15 14:57:46.854580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 143/277] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:46 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:46.973439 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e4f7aaef-3ecd-4568-96f3-8ddc6931cc66 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:46.974069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e4f7aaef-3ecd-4568-96f3-8ddc6931cc66 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:46.974454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:46.975077 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:46.981542 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.981988 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.982805 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.983265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.985350 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4f7aaef-3ecd-4568-96f3-8ddc6931cc66 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.986550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4f7aaef-3ecd-4568-96f3-8ddc6931cc66 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:46.987349 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4f7aaef-3ecd-4568-96f3-8ddc6931cc66 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:46.987795 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4f7aaef-3ecd-4568-96f3-8ddc6931cc66 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.012181 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e4f7aaef-3ecd-4568-96f3-8ddc6931cc66 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/ips" status: 200 len: 152 microversion: 2.20 time: 0.044065 Jun 15 14:57:47.012855 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 135/278] 10.222.0.23 () {60 vars in 1288 bytes} [Wed Jun 15 14:57:46 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 14:57:47.097521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4ee550af-177e-491c-89ab-8068be8042d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:47.098600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4ee550af-177e-491c-89ab-8068be8042d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:47.106529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ee550af-177e-491c-89ab-8068be8042d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.107104 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ee550af-177e-491c-89ab-8068be8042d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.109126 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ee550af-177e-491c-89ab-8068be8042d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.110827 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ee550af-177e-491c-89ab-8068be8042d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.129243 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:47.142991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4ee550af-177e-491c-89ab-8068be8042d7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/ips" status: 200 len: 149 microversion: 2.1 time: 0.050025 Jun 15 14:57:47.144236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 136/279] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 14:57:47 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:47.151360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:47.160583 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4bc5e9ce-cf26-4cc2-b2d2-ecd68a5c5caf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.192329 Jun 15 14:57:47.161375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 144/280] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:46 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:47.510444 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:47.511065 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:47.517245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.517695 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.518594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.519197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.664694 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:47.673359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4306b870-1ed8-4a5f-a9bd-7276ee50fd22 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.168633 Jun 15 14:57:47.673922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 137/281] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:47 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:47.872628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:47.873311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:47.880872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.881349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:47.882146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:47.882561 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.019948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:48.027480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8159c666-23c4-44a8-bccb-0347b47f2f9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.159655 Jun 15 14:57:48.028041 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 145/282] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:47 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:48.178484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:48.179106 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:48.187111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:48.187576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.188355 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:48.188794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.319745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:48.331678 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-765c57d7-8d53-4389-8fd0-d2204beb7cbf tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.157287 Jun 15 14:57:48.332517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 138/283] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:48 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:48.690560 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:48.691374 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:48.701031 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:48.701971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.703256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:48.704013 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:48.859715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:48.861900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:48.869206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b3a4597d-2b44-432d-beba-ce64adf3da28 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.183083 Jun 15 14:57:48.870445 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 146/284] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:48 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:49.044952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:49.045551 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:49.052343 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.052790 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.053565 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.054004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.132392 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-cccd8465-247b-43c8-93fb-850f039cce83 req-fa3af0b6-9933-431c-92d6-1b2ac3e4d1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd8ef1d-c5d2-429c-839b-cb3e236bbb17", "name": "network-vif-plugged", "status": "completed", "tag": "c95a6e62-c8ac-4e01-b99e-c17859e54779"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:49.140851 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-cccd8465-247b-43c8-93fb-850f039cce83 req-fa3af0b6-9933-431c-92d6-1b2ac3e4d1a5 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.141351 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-cccd8465-247b-43c8-93fb-850f039cce83 req-fa3af0b6-9933-431c-92d6-1b2ac3e4d1a5 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.152836 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-cccd8465-247b-43c8-93fb-850f039cce83 req-fa3af0b6-9933-431c-92d6-1b2ac3e4d1a5 service nova] Creating event network-vif-plugged:c95a6e62-c8ac-4e01-b99e-c17859e54779 for instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 on hv-cinder-84517 Jun 15 14:57:49.158945 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-cccd8465-247b-43c8-93fb-850f039cce83 req-fa3af0b6-9933-431c-92d6-1b2ac3e4d1a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030501 Jun 15 14:57:49.159702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 147/285] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:57:49.193895 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:49.201448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ff2cc8ad-f965-4c89-ae7b-338a18b8426a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1503 microversion: 2.1 time: 0.160387 Jun 15 14:57:49.202000 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 139/286] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:49 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:49.218875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b5337de-51d8-4c23-a7d7-2db03d3d8fe2"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:49.220163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:49.233336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.233336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.233336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.233336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.252801 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] HTTP exception thrown: Cannot 'attach_volume' instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc while it is in vm_state rescued Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Request method failure captured: Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: POST /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc/os-volume_attachments HTTP/1.1 Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 74 Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfL7VT0clRDZfL7x3_66jziJtK6z-0PVYCUkCP9eyGovsLr76J9px7zhftxgQBzjQ7S6QIC9D-zHaWdZ3t8aaxLb2qB8iCiCoSY7DAhftK1wKERI1XOpQ-PCuTdsQQzVyAMXaDHzg-8mIud9GRU3ikcX7K7Q77bzyUBLb8m2-5AoCi4 Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 14:57:49.254618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: cbc9d5ce4a3241ea898f216543114fdf Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {"volumeAttachment": {"volumeId": "8b5337de-51d8-4c23-a7d7-2db03d3d8fe2"}} Jun 15 14:57:49.256109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Cannot 'attach_volume' instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc while it is in vm_state rescued Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'server_id': '6fbdc341-c8d4-435d-a52c-9e4387a70cfc', 'body': {'volumeAttachment': {'volumeId': '8b5337de-51d8-4c23-a7d7-2db03d3d8fe2'}}} Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:57:49.256940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc while it is in vm_state rescued Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:57:49.258578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:57:49.259622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:57:49.259622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:57:49.259622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc while it is in vm_state rescued Jun 15 14:57:49.259622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:57:49.259622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Returning 409 to user: Cannot 'attach_volume' instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc while it is in vm_state rescued {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:57:49.259622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-64262b22-93e4-4a33-890f-d7459b7e5293 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042123 Jun 15 14:57:49.259622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 148/287] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 14:57:49 2022] POST /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 14:57:49.265753 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-174dd3e8-efff-4e32-a4fb-ab4e73eaffd8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:49.266554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-174dd3e8-efff-4e32-a4fb-ab4e73eaffd8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:49.272982 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-174dd3e8-efff-4e32-a4fb-ab4e73eaffd8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.290749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-174dd3e8-efff-4e32-a4fb-ab4e73eaffd8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.290749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-174dd3e8-efff-4e32-a4fb-ab4e73eaffd8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.290749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-174dd3e8-efff-4e32-a4fb-ab4e73eaffd8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.349789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:49.350428 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:49.356463 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.356902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.357920 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.358147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.496948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:49.505235 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bfb1e515-3793-4563-bf6b-bc40dca15d3a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.159240 Jun 15 14:57:49.505949 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 149/288] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:49 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:49.548389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-174dd3e8-efff-4e32-a4fb-ab4e73eaffd8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc/action" status: 202 len: 0 microversion: 2.1 time: 0.286904 Jun 15 14:57:49.549009 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 140/289] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 14:57:49 2022] POST /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 14:57:49.558274 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:49.558900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:49.565936 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.568326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.568326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.568326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.704996 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:49.712552 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c4c5b875-481c-4b0f-8a96-1a95c278d53f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1511 microversion: 2.1 time: 0.159293 Jun 15 14:57:49.713108 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 150/290] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:49 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:49.887168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:49.887861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:49.894836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.895286 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:49.896329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:49.896820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.041447 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:50.049720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5d32f59a-064c-4f4b-bba7-90804933bd25 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.166895 Jun 15 14:57:50.050327 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 141/291] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:49 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:50.493088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c2a586dd-dcaf-4eff-b369-ff733599f5f5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aac54778-f972-4ec5-8d4b-2cc9591132f1"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:50.494013 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c2a586dd-dcaf-4eff-b369-ff733599f5f5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:50.501549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2a586dd-dcaf-4eff-b369-ff733599f5f5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.506147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2a586dd-dcaf-4eff-b369-ff733599f5f5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.506147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2a586dd-dcaf-4eff-b369-ff733599f5f5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.506147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2a586dd-dcaf-4eff-b369-ff733599f5f5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.522879 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:50.523390 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:50.535194 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.535713 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.536505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.536937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.680586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:50.688539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2a83ec6e-81d2-42a8-bfea-42556f06e746 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1315 microversion: 2.1 time: 0.169728 Jun 15 14:57:50.689116 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 142/292] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:50 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:50.728528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:50.729125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:50.735714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.736155 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.736906 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:50.737341 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:50.885387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:50.885387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f9789f0c-57bb-48cd-bf07-6f4335bd7752 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1511 microversion: 2.1 time: 0.159341 Jun 15 14:57:50.885387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 143/293] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:50 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:51.067723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:51.068333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:51.074377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:51.074827 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:51.075582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:51.076014 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:51.344735 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:51.353717 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d263591a-a19c-43d7-9f29-7fb739e5c982 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.289955 Jun 15 14:57:51.356079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 144/294] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:51 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:51.361863 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:51.362578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:51.370147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:51.370630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:51.371405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:51.371874 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:51.395075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lazy-loading 'flavor' on Instance uuid 77f6014d-9ea6-47c4-af6c-719e09d8d193 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:57:52.297937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-71e15a47-fa3b-4575-bcb5-2d0639bc14d2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/action" status: 202 len: 0 microversion: 2.20 time: 0.941800 Jun 15 14:57:52.298648 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 145/295] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Jun 15 14:57:51 2022] POST /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/action => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:57:52.306916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:52.307611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:52.314977 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.328071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.328071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.328071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.475366 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:52.486434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ef752c25-e436-4023-9f58-5ae6195383a9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1464 microversion: 2.1 time: 0.183572 Jun 15 14:57:52.487011 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 146/296] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:52 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1464 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:52.491482 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:52.492641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:52.501012 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.501797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.502507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.503012 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.639831 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:52.647093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-eb12d471-31da-4ffa-a862-61b86c14ff4f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1511 microversion: 2.1 time: 0.159150 Jun 15 14:57:52.647710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 147/297] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:52 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:52.652142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:52.652733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:52.659664 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.660116 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.660909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.661350 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.688907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c2a586dd-dcaf-4eff-b369-ff733599f5f5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.199916 Jun 15 14:57:52.689515 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 151/298] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 14:57:50 2022] POST /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments => generated 194 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:52.695925 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:52.695925 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:52.702275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.702910 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.703702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.704143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.861976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:52.871240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:52.872758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:52.874572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-09ef8f30-2487-4b37-834f-ce4c1a3b6bf8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.225820 Jun 15 14:57:52.875557 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 148/299] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:57:52 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:57:52.880160 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:52.880657 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:52.886869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.887322 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.888093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:52.888530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:52.890935 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:52.898719 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0de8229b-4e9f-4666-87bb-adc4a803b987 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1319 microversion: 2.1 time: 0.208086 Jun 15 14:57:52.899559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 152/300] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:52 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:52.914232 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:57:52.941629 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:57:53.169376 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2ef7ca48-ea84-4dfd-b75c-54732c2fe869 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:53.169867 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2ef7ca48-ea84-4dfd-b75c-54732c2fe869 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:53.176363 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ef7ca48-ea84-4dfd-b75c-54732c2fe869 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.182541 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ef7ca48-ea84-4dfd-b75c-54732c2fe869 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.182541 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ef7ca48-ea84-4dfd-b75c-54732c2fe869 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.182541 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ef7ca48-ea84-4dfd-b75c-54732c2fe869 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.201924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2ef7ca48-ea84-4dfd-b75c-54732c2fe869 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/ips" status: 200 len: 145 microversion: 2.1 time: 0.035553 Jun 15 14:57:53.202553 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 153/301] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 14:57:53 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:57:53.444151 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e77289b4-2253-4648-b834-bee1a5e4edcd tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "DELETE /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 204 len: 0 microversion: 2.1 time: 0.567251 Jun 15 14:57:53.444788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 149/302] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 14:57:52 2022] DELETE /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:57:53.453017 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:53.453665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:53.459790 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.460246 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.461005 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.461451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.592939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:53.600488 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8fa12668-69e9-432a-88e3-daad5b10f8e2 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1470 microversion: 2.1 time: 0.151484 Jun 15 14:57:53.601044 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 154/303] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:53 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:53.665148 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:53.666080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:53.674048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.674715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.675508 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.675940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.839342 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:53.850337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-91a4e189-5f8e-47e7-b86b-12de9231a67b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1511 microversion: 2.1 time: 0.189348 Jun 15 14:57:53.850999 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 150/304] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:53 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:53.893351 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:53.894046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:53.900978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.901512 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.902381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.902900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.915844 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:53.916614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:53.923135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.923582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:53.924397 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:53.924833 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.101500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:54.106370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:54.113216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:54.113216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:54.113216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-064a2bba-f8a4-4df6-b050-5c4d202e2043 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.224437 Jun 15 14:57:54.116118 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-00e83d15-ab89-45c4-81c6-20025ac95160 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1508 microversion: 2.1 time: 0.204233 Jun 15 14:57:54.128972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 151/305] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:53 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:54.129273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 155/306] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:57:53 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:57:54.619582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:54.620192 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:54.627999 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.628440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.629200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.629630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.762123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:54.770851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-94d6e2ab-f5b2-49aa-a345-9ea620b1b7b9 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1470 microversion: 2.1 time: 0.155836 Jun 15 14:57:54.771413 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 152/307] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:54 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:54.867611 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:54.868226 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:54.875358 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.875816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:54.876588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:54.877034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:55.020455 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:55.028830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e226e841-572d-45ee-ae1f-cdbd413f4783 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1511 microversion: 2.1 time: 0.164993 Jun 15 14:57:55.030610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 156/308] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:54 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:55.131699 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:55.132300 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:55.139041 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:55.139526 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:55.140282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:55.140715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:55.279173 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:55.287757 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:55.289285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:55.290547 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-88ad45de-b8d7-4574-b2fc-47dbc69f128a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.162588 Jun 15 14:57:55.291103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 153/309] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:57:55 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:57:55.788684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:55.789209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:55.797323 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:55.797772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:55.798756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:55.799710 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:55.969348 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:55.979793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-86065eb4-fe13-4388-9476-d65c642c6703 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1470 microversion: 2.1 time: 0.195234 Jun 15 14:57:55.980453 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 157/310] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:55 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:56.047571 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:56.048766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:56.057323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:56.058235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:56.059171 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:56.059642 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:56.236800 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:56.251277 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d288de9c-16ec-499e-9a2e-e42af1a52f38 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1517 microversion: 2.1 time: 0.207457 Jun 15 14:57:56.252091 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 154/311] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:56 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:56.309619 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:56.310230 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:56.321206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:56.321657 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:56.322521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:56.322956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:56.486067 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:56.494648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:56.496143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:56.497634 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1b5fb58a-a52f-4461-add3-5197af14274a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.192133 Jun 15 14:57:56.498207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 158/312] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:57:56 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:57:56.998720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:56.999337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:57.006213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.008616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.008616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.008616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.143435 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:57.150912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-30f6d739-c192-4b07-85b3-3fe6fe61e04d tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1470 microversion: 2.1 time: 0.156700 Jun 15 14:57:57.151497 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 155/313] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:56 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:57.518341 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:57.519034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:57.526544 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.526989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.527834 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:57.528990 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:57.677628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:57.686908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:57.688780 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:57.689956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-af30c4a6-f0f5-4e30-8cc2-eb5c5bda010b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.175906 Jun 15 14:57:57.690691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 159/314] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:57:57 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:57:58.170851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:58.172077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:58.178784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.179226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.179994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.180427 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.275028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-77e81b32-44ac-4dae-bf40-f6f8b8233b3e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1adb842f-fec2-4c67-88ee-8a176e7d184e"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:58.276280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-77e81b32-44ac-4dae-bf40-f6f8b8233b3e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:58.283450 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e81b32-44ac-4dae-bf40-f6f8b8233b3e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.284168 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e81b32-44ac-4dae-bf40-f6f8b8233b3e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.285253 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e81b32-44ac-4dae-bf40-f6f8b8233b3e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.285687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e81b32-44ac-4dae-bf40-f6f8b8233b3e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.315058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:58.330269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-348a4f61-313a-4ead-9f4c-de96d504da96 tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1470 microversion: 2.1 time: 0.165200 Jun 15 14:57:58.338523 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 156/315] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:58 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:57:58.709579 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:58.710466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:58.716914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.717371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:58.718144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:58.718629 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.187357 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:59.196267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:59.197506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:59.198985 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5fc60ea6-2e64-4e34-b4e2-70ba99706270 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.493626 Jun 15 14:57:59.199554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 157/316] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:57:58 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:57:59.213954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-a0406a20-9d39-4a76-a544-fe91117e041f req-bc11e1ae-64b5-4a6f-8b6c-6d3034316f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd87633-dc29-4c78-851a-a052d758173d", "name": "network-vif-deleted", "tag": "82ecae61-5294-40dd-ae1f-4c5a9700436b"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:59.223745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-a0406a20-9d39-4a76-a544-fe91117e041f req-bc11e1ae-64b5-4a6f-8b6c-6d3034316f6b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:59.224199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-a0406a20-9d39-4a76-a544-fe91117e041f req-bc11e1ae-64b5-4a6f-8b6c-6d3034316f6b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.236998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-a0406a20-9d39-4a76-a544-fe91117e041f req-bc11e1ae-64b5-4a6f-8b6c-6d3034316f6b service nova] Creating event network-vif-deleted:82ecae61-5294-40dd-ae1f-4c5a9700436b for instance acd87633-dc29-4c78-851a-a052d758173d on hv-cinder-84517 Jun 15 14:57:59.241896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-a0406a20-9d39-4a76-a544-fe91117e041f req-bc11e1ae-64b5-4a6f-8b6c-6d3034316f6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041228 Jun 15 14:57:59.242530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 158/317] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:57:59.355238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:57:59.355238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:57:59.358448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:59.358900 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.359672 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:57:59.360125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:57:59.427046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:57:59.436287 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-95c9a5c2-f85a-48a8-b7fe-c9f5700155aa tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1428 microversion: 2.1 time: 0.089375 Jun 15 14:57:59.440362 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 159/318] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:57:59 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:57:59.559855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-77e81b32-44ac-4dae-bf40-f6f8b8233b3e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.287862 Jun 15 14:57:59.560618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 160/319] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 14:57:58 2022] POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-volume_attachments => generated 194 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:57:59.916082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c6f2c501-f1cb-4541-b188-11c9337cdcb2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'create', calling method: .version_select at 0x7f693a64f8b0>, body: {"keypair": {"name": "tempest-keypair-2134871872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLyLYcIHZdVj4/56EBP4cTcjjHs8zUUsiexWlJWYUYtHwz4stA9Ldafcm9nfqti+gpbr3ipzmdy6OiFqw8zuep21PrzTW/9/3bvTEDZu1iIRLk9g0kP4/KeVew4yCIbFA=="}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:57:59.935147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-c6f2c501-f1cb-4541-b188-11c9337cdcb2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:57:59.939463 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-c6f2c501-f1cb-4541-b188-11c9337cdcb2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for user cbc9d5ce4a3241ea898f216543114fdf and project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:00.084477 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c6f2c501-f1cb-4541-b188-11c9337cdcb2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172390 Jun 15 14:58:00.084971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 160/320] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 14:57:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:00.219948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:00.220836 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:00.229995 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.230751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.232201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.232201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.412524 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:00.432209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:00.434975 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:00.436395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3384dce8-f19e-4ba1-abe0-7be6d92e071c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.221723 Jun 15 14:58:00.446627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 161/321] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:00 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:00.453683 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:00.459688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:00.461329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.461862 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.462937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.463543 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.500429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:00.500881 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:00.501376 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lazy-loading 'fault' on Instance uuid acd87633-dc29-4c78-851a-a052d758173d {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:58:00.545717 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a74a23b13e24616921c55bc6226216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a6143a5b05471e8aed517230f734e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:00.555469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ece4b6f8-ee11-4d5e-8099-3c176264fa8c tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 200 len: 1305 microversion: 2.1 time: 0.105080 Jun 15 14:58:00.556048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 161/322] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:00 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:01.457022 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:01.457789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:01.466042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.466687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.467650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.468099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.472486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:01.577707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:01.584762 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] [instance: acd87633-dc29-4c78-851a-a052d758173d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:01.592860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.593305 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.594077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:01.594865 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:01.622467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] HTTP exception thrown: Instance acd87633-dc29-4c78-851a-a052d758173d could not be found. Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Request method failure captured: Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d HTTP/1.1 Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfNSZfHNLzkp1cKH_ocPZ4zT8Fd4XZZEM5Sq_UFnaHuXKwQkc1MpVK-6OCZDNxLZ4lZc6eskCkvnJ0CHiGclcRkwTfGC9YDvF-lBgaPYIj69ZqurrPHYyQv0CbHacBCrbtv-I_al-cpQcv2OAJODa75l41TryZz8kArGD-17aatwhVU Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 22a6143a5b05471e8aed517230f734e7 Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-VolumesNegativeTest-347574375 Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 14:58:01.624096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22a6143a5b05471e8aed517230f734e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/22a6143a5b05471e8aed517230f734e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_22a6143a5b05471e8aed517230f734e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/22a6143a5b05471e8aed517230f734e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-VolumesNegativeTest-347574375 Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 22a6143a5b05471e8aed517230f734e7 Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-VolumesNegativeTest-347574375 Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-VolumesNegativeTest-347574375-project Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 8a74a23b13e24616921c55bc6226216f Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-VolumesNegativeTest-347574375-project Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance acd87633-dc29-4c78-851a-a052d758173d could not be found. Jun 15 14:58:01.625479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'acd87633-dc29-4c78-851a-a052d758173d'} Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd87633-dc29-4c78-851a-a052d758173d could not be found. Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:58:01.626330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd87633-dc29-4c78-851a-a052d758173d could not be found. Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd87633-dc29-4c78-851a-a052d758173d could not be found. Jun 15 14:58:01.627837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 14:58:01.628950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] Returning 404 to user: Instance acd87633-dc29-4c78-851a-a052d758173d could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:58:01.628950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5d19c037-61eb-498c-8299-1d8f5aa4153a tempest-VolumesNegativeTest-347574375 tempest-VolumesNegativeTest-347574375-project] 10.222.0.23 "GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d" status: 404 len: 111 microversion: 2.1 time: 0.052385 Jun 15 14:58:01.628950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 162/323] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:01 2022] GET /compute/v2.1/servers/acd87633-dc29-4c78-851a-a052d758173d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 14:58:01.642300 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:01.651485 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:01.655010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:01.657673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-26fb679b-94c4-4925-b50d-7164707725a1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.204490 Jun 15 14:58:01.658696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 162/324] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:01 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:02.679659 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:02.679659 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:02.684124 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.684572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.685374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:02.685811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:02.870212 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:02.879230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:02.880816 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:02.881977 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9bb3ff2a-6fef-4a52-9e6c-835730d3b13f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.209086 Jun 15 14:58:02.888483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 163/325] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:02 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:03.431349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-242929226", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19a21454-d50c-4eae-a0c5-6c91a597b220"}], "security_groups": [{"name": "tempest-securitygroup--1537866477"}], "key_name": "tempest-keypair-2134871872", "user_data": "}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:03.901116 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:03.902400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:03.908926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.909376 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:03.910149 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:03.910611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.050155 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.058597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.060335 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:04.061618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-956b03d7-58ba-415d-9dfb-7e4a126e0368 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.164517 Jun 15 14:58:04.062423 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 164/326] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:03 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:04.340982 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] validate_networks() for [('19a21454-d50c-4eae-a0c5-6c91a597b220', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:58:04.749741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:58:04.750317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:58:04.750684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:58:04.751120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:58:04.751536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:58:04.760225 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.761181 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.761981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:04.762444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:04.779791 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:04.783664 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Getting quotas for user cbc9d5ce4a3241ea898f216543114fdf and project 65a03d17e6f54c66bb4ca7571246be87. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:04.794724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:58:04.796978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:58:05.080692 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:05.081209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:05.087967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.088420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.089351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:05.089797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:05.226822 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:05.235729 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:05.237204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:05.238394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-bb082518-083e-44c2-afc0-82ac8d19d874 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.161744 Jun 15 14:58:05.238944 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 165/327] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:05 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:05.254742 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bfcfaa60-89fd-4854-81bb-a85e8e33b283 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.827915 Jun 15 14:58:05.268855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 163/328] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:58:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:58:05.277769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7296e0ca-e952-46b1-a917-48945738b5b5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:05.278442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7296e0ca-e952-46b1-a917-48945738b5b5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:05.286015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:05.333018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7296e0ca-e952-46b1-a917-48945738b5b5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:05.341517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7296e0ca-e952-46b1-a917-48945738b5b5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1245 microversion: 2.1 time: 0.067668 Jun 15 14:58:05.342257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 166/329] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:05 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:06.260883 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:06.261479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:06.268223 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.268667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.269428 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:06.269866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:06.366037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8d011038-ba33-49d2-9837-919049f8c7fb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:06.367494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8d011038-ba33-49d2-9837-919049f8c7fb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:06.434203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.435314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8d011038-ba33-49d2-9837-919049f8c7fb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.442299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8d011038-ba33-49d2-9837-919049f8c7fb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1245 microversion: 2.1 time: 0.080162 Jun 15 14:58:06.442598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.442862 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 167/330] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:06 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:06.444241 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:06.445627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-21d8fd8d-0e50-46c1-8b00-ca49f5f5df39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.189704 Jun 15 14:58:06.446390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 164/331] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:06 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:07.460431 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:07.461545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:07.467005 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:07.467647 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:07.469702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.470391 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.471425 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.473563 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.473716 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.474010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.474815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:07.475543 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:07.546519 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.560613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0822de7a-5a8b-4ff6-aa57-1a610a92e5fe tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1241 microversion: 2.1 time: 0.104605 Jun 15 14:58:07.561203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 168/332] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:07 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:07.645875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.654715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.656213 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:07.657384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-12383d15-b237-4580-a3b8-65d5c05ec9d0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.196693 Jun 15 14:58:07.657966 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 165/333] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:07 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:08.030663 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a468c902-a1c6-4e24-9497-d218b6996191 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: .version_select at 0x7f693a5764c0>, body: {"keypair": {"name": "tempest-keypair-485096880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdr4+oKkB3qUvrpkM1nzPQ5cqr+XMu2vUG3hvkz3ObBqO0mWL8NEGw2LznwW/45hNjUGSp7rnMN+Q997EfReE8JpJ2zjhK2P0tAF82eHvXspdeg//iQxC2kWN1VR2idfA=="}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:08.051571 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-a468c902-a1c6-4e24-9497-d218b6996191 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:08.053769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-a468c902-a1c6-4e24-9497-d218b6996191 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:08.207997 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a468c902-a1c6-4e24-9497-d218b6996191 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182385 Jun 15 14:58:08.208758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 169/334] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 14:58:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:08.578817 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:08.580028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:08.583348 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:08.599215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.613513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.613513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.613513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.679880 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:08.680740 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:08.686140 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.688635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.689649 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.690962 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:08.691636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:08.696656 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2ab3cf9f-7749-46c6-9dc5-a711c26b1ec7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1305 microversion: 2.1 time: 0.122059 Jun 15 14:58:08.699034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 166/335] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:08 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:08.708157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:08.899371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.909953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.911867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:08.913553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b345a30b-d8fa-44c7-8e61-3ce517809284 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.240037 Jun 15 14:58:08.914245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 170/336] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:08 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:09.720727 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:09.721339 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:09.730434 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.731360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.733299 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.733920 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.933010 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:09.933629 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:09.940691 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.941141 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:09.941972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:09.942432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:10.068848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.077076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-88760268-2e17-4e8b-9c25-f52b0932da42 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.360596 Jun 15 14:58:10.077642 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 167/337] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:09 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:10.187639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.196914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.199788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:10.201053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-56ad2630-4466-4b37-9006-1f989ca46c0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.272584 Jun 15 14:58:10.201610 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 171/338] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:09 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:11.095713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:11.097171 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:11.117819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.119951 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.121392 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.122068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.221702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:11.222346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:11.230726 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.231175 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.231946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.232378 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.597100 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:11.606290 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-caddcc98-b10f-4421-a146-8a09044b14cf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.515431 Jun 15 14:58:11.615981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 168/339] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:11 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:11.627734 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:11.653627 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:11.655326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:11.656808 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7a88d07c-d47c-49bf-9dc7-d09b4087f7ad tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1745 microversion: 2.20 time: 0.440997 Jun 15 14:58:11.657361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 172/340] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:11 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1745 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:11.885036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-a5a12da8-fc56-463c-8662-0c55064a95c4 req-b25e4ff1-c679-4e19-9324-630f2fec37a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8490a7b-6956-4086-a14b-8d892496d608", "tag": "36d09c08-3dcb-4a3b-9fc2-a993412d350d"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:11.904902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-a5a12da8-fc56-463c-8662-0c55064a95c4 req-b25e4ff1-c679-4e19-9324-630f2fec37a8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:11.905393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-a5a12da8-fc56-463c-8662-0c55064a95c4 req-b25e4ff1-c679-4e19-9324-630f2fec37a8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:11.926647 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-a5a12da8-fc56-463c-8662-0c55064a95c4 req-b25e4ff1-c679-4e19-9324-630f2fec37a8 service nova] Creating event network-changed:36d09c08-3dcb-4a3b-9fc2-a993412d350d for instance e8490a7b-6956-4086-a14b-8d892496d608 on hv-cinder-84517 Jun 15 14:58:11.945815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-a5a12da8-fc56-463c-8662-0c55064a95c4 req-b25e4ff1-c679-4e19-9324-630f2fec37a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068465 Jun 15 14:58:11.945815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 169/341] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:12.292666 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2051061259", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f4844db-ed6c-4bba-97af-aa7e459b2e26"}], "security_groups": [{"name": "tempest-securitygroup--107060999"}], "key_name": "tempest-keypair-485096880", "user_data": "}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:12.401845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] validate_networks() for [('6f4844db-ed6c-4bba-97af-aa7e459b2e26', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:58:12.625636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:12.627089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:12.635299 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.636061 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.636965 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:12.637538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:12.995486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.008210 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d4369049-914a-434e-8ee5-a7bff34dda2b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.388389 Jun 15 14:58:13.010671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 170/342] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:12 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:13.019260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:13.021493 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:13.029844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.030822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.031779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.032366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.187616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:58:13.188346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:58:13.188986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:58:13.189614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:58:13.190261 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:58:13.201597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.202625 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.203769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.204902 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.227693 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:13.233652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:13.248762 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:58:13.252516 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:58:13.296749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.302694 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.304852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.306858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-822507bd-9e82-46b5-97c6-5497e225e2fd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1745 microversion: 2.20 time: 0.292763 Jun 15 14:58:13.307814 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 171/343] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:13 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1745 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:13.312701 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-1902ec30-4cac-48a5-9239-8f92738ac3b2 req-365f702c-1749-4e41-9538-b63e1f022b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6014d-9ea6-47c4-af6c-719e09d8d193", "name": "network-vif-plugged", "status": "completed", "tag": "08f6804f-9163-46e0-a8a3-e6d5513b1c44"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:13.322882 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-1902ec30-4cac-48a5-9239-8f92738ac3b2 req-365f702c-1749-4e41-9538-b63e1f022b46 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:13.323506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-1902ec30-4cac-48a5-9239-8f92738ac3b2 req-365f702c-1749-4e41-9538-b63e1f022b46 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:13.336592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-1902ec30-4cac-48a5-9239-8f92738ac3b2 req-365f702c-1749-4e41-9538-b63e1f022b46 service nova] Creating event network-vif-plugged:08f6804f-9163-46e0-a8a3-e6d5513b1c44 for instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 on hv-cinder-84517 Jun 15 14:58:13.343181 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-1902ec30-4cac-48a5-9239-8f92738ac3b2 req-365f702c-1749-4e41-9538-b63e1f022b46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 Jun 15 14:58:13.344136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 172/344] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:13.437608 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a3e10cca-9227-460f-8e15-62b78461a783 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.149733 Jun 15 14:58:13.438319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 173/345] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:58:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:58:13.450751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5a3189a4-ec6f-4b47-b168-6e2ad287a01e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:13.451480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5a3189a4-ec6f-4b47-b168-6e2ad287a01e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:13.549410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5a3189a4-ec6f-4b47-b168-6e2ad287a01e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:13.558888 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5a3189a4-ec6f-4b47-b168-6e2ad287a01e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1241 microversion: 2.1 time: 0.114131 Jun 15 14:58:13.559461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 173/346] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:13 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:14.026769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:14.027381 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:14.034560 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.035011 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.035792 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.036232 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.189623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.197802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6f70ad12-6f65-42eb-a317-18eea2573ccf tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.174988 Jun 15 14:58:14.198500 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 174/347] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:14 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:14.325963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:14.326602 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:14.338777 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.339233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.340021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.340466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.505809 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.518722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.520361 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.521815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ceee1121-66ef-45c6-89a2-fa8739676a44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.200613 Jun 15 14:58:14.522779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 174/348] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:14 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:14.576699 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:14.577534 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:14.593728 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.593728 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.593728 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:14.593728 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:14.659843 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:14.669578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b0c22755-3000-4b91-be85-4d65e175dd15 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1245 microversion: 2.1 time: 0.096775 Jun 15 14:58:14.670516 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 175/349] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:14 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:15.216976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:15.218983 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:15.221936 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:15.229210 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.230366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.231342 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.232588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.497741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:15.505410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1e374947-c149-4edd-9b16-563f5fa63d1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.294421 Jun 15 14:58:15.505971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 175/350] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:15 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:15.544563 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:15.545173 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:15.554291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.554742 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.556314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.556898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.687046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:15.687791 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:15.695013 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:15.698109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.699477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.700456 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:15.700900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:15.704761 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:15.713147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:15.714722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1292e0bf-c12d-43af-be6d-b6b8ba9498b7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.174089 Jun 15 14:58:15.715609 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 176/351] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:15 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:15.802050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:15.811923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-16ce33d8-8794-4643-83b3-ffab75aab69c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1245 microversion: 2.1 time: 0.129149 Jun 15 14:58:15.822751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 176/352] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:15 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:16.523139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:16.524337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:16.535422 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.535969 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.538405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.538934 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.733022 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:16.734311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:16.742462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.743161 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.745323 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.746240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.903914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:16.915036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e79ebbf8-41d0-4771-86d9-8fff193432c5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.395296 Jun 15 14:58:16.925743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 177/353] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:16 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:16.931002 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:16.931629 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:16.940871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.941330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:16.942120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:16.942760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.098956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:17.105743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:17.121112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-65923fbe-af70-4036-b901-88e44244ab81 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1237 microversion: 2.1 time: 0.193948 Jun 15 14:58:17.121593 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:17.127927 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:17.130483 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-89d4e836-d6f0-48a1-9b83-276dca978256 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.401276 Jun 15 14:58:17.134795 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 178/354] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:16 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1237 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:17.137447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 177/355] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:16 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:17.430928 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6487f69a-a1d7-46f6-84b9-fa00b3f588e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:17.439979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6487f69a-a1d7-46f6-84b9-fa00b3f588e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.440452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6487f69a-a1d7-46f6-84b9-fa00b3f588e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.514749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6487f69a-a1d7-46f6-84b9-fa00b3f588e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Going to try to stop instance {{(pid=124694) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 14:58:17.927932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6487f69a-a1d7-46f6-84b9-fa00b3f588e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action" status: 202 len: 0 microversion: 2.1 time: 0.501871 Jun 15 14:58:17.929307 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 179/356] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 14:58:17 2022] POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:17.933573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:17.934934 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:17.948126 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.950027 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.952332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.952957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.953905 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:17.954743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:17.964881 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.966441 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:17.967818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:17.969479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.295590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.305496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-eac5e9ef-a576-4775-90fc-f62b8fd78ab8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.376425 Jun 15 14:58:18.320618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 178/357] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:17 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:18.331560 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-74d6276b-6201-4b69-851a-0bee734446fb req-f712b9ac-a6ef-4784-a4ba-12c5cf6db98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8490a7b-6956-4086-a14b-8d892496d608", "name": "network-vif-plugged", "status": "completed", "tag": "36d09c08-3dcb-4a3b-9fc2-a993412d350d"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:18.346880 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-74d6276b-6201-4b69-851a-0bee734446fb req-f712b9ac-a6ef-4784-a4ba-12c5cf6db98f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.347815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-74d6276b-6201-4b69-851a-0bee734446fb req-f712b9ac-a6ef-4784-a4ba-12c5cf6db98f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.360016 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.361906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-74d6276b-6201-4b69-851a-0bee734446fb req-f712b9ac-a6ef-4784-a4ba-12c5cf6db98f service nova] Creating event network-vif-plugged:36d09c08-3dcb-4a3b-9fc2-a993412d350d for instance e8490a7b-6956-4086-a14b-8d892496d608 on hv-cinder-84517 Jun 15 14:58:18.368611 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-74d6276b-6201-4b69-851a-0bee734446fb req-f712b9ac-a6ef-4784-a4ba-12c5cf6db98f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046248 Jun 15 14:58:18.369507 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 179/358] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:18.372668 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-19e72198-bba6-420e-be61-9c5ee7146833 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.437134 Jun 15 14:58:18.376933 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:18.377958 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:18.384412 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 180/359] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:17 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:18.385717 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.386508 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.387989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.388708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.400904 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:18.401122 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:18.409964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.410779 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.411720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.412388 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.517960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.538112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b6c9b624-8d75-4f0f-905f-b8a036701279 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1301 microversion: 2.1 time: 0.167010 Jun 15 14:58:18.556147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 180/360] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:18 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:18.747467 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-59fa42b5-4492-4288-9e4d-0b161abd0ca5 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69717c1-8644-4a9a-a269-c89a61e76398", "device": "/dev/sdb"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:18.754902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-59fa42b5-4492-4288-9e4d-0b161abd0ca5 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:18.761907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59fa42b5-4492-4288-9e4d-0b161abd0ca5 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.765616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59fa42b5-4492-4288-9e4d-0b161abd0ca5 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.766839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59fa42b5-4492-4288-9e4d-0b161abd0ca5 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:18.770852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59fa42b5-4492-4288-9e4d-0b161abd0ca5 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:18.794157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.819654 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.827631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:18.840567 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-02bbabec-9737-423f-8042-a79821212251 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.443583 Jun 15 14:58:18.845386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 181/361] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:18 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:19.324739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:19.325333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:19.331701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:19.332142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:19.339643 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:19.340103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:19.595000 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:19.605244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-12185023-14d4-46ca-9c4d-4f70699cb7dc tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.284930 Jun 15 14:58:19.615144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 182/362] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:19 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:19.617007 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:19.617783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:19.627730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:19.628182 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:19.628971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:19.629445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:19.952621 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:19.963994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-343715be-e7b5-460b-8ebc-4399f4b10e96 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.352100 Jun 15 14:58:19.965014 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 183/363] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:19 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:19.980179 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:19.982767 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:20.001644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.002821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.003819 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.004612 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.112661 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.136919 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f3890e8f-e5cd-465e-b6d6-6d8bb4709e0b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1299 microversion: 2.1 time: 0.170597 Jun 15 14:58:20.138136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 184/364] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:19 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:20.145878 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:20.149389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:20.158074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.158850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.159842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.160469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.369222 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.383588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.383812 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.385630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-03cdfd09-0e84-4e90-8136-da6b48a94618 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.246041 Jun 15 14:58:20.386451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 185/365] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:20 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:20.623720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:20.624245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:20.644711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.645450 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.646835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:20.647433 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:20.907198 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:20.915048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:20.925919 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ef3ae723-8d94-482e-bf37-cf55f1671f1a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.306031 Jun 15 14:58:20.938650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 186/366] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:20 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:20.988625 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:20.991066 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.001476 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.001953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.002911 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.004417 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.181514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.206377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-30cee97b-a121-477e-b8c0-2b9bbce47852 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.226517 Jun 15 14:58:21.211517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 187/367] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:20 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:21.219334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.220382 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.246912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.246912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.246912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.246912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.334464 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.353533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b6635cf1-995d-4c37-9a77-1e1610e3e43f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1299 microversion: 2.1 time: 0.140100 Jun 15 14:58:21.363048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 188/368] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1299 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:21.404978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.405605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.413916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.414416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.422554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.422554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.610958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.621011 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.623223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:21.624741 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2434abaa-cd89-491b-9ad5-585e99d169dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.223889 Jun 15 14:58:21.641784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 189/369] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:21.947541 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:21.948423 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:21.956213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.956359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:21.957068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:21.957505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.112798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:22.150207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:22.159275 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-60ceeb7c-1965-41e3-9eee-ee325da3a5d5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.217814 Jun 15 14:58:22.160054 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 190/370] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:21 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:22.228837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:22.229460 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:22.235646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.236101 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.236876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.237320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.407307 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:22.420885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a532a7a1-24a7-44c6-a519-0e35c5bc47ae tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.196346 Jun 15 14:58:22.424048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 191/371] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:22 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:22.433418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:22.433418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:22.443139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.443835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.444824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.445265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.538574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:22.552184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9553063f-df8c-49dc-a2ba-9a380fb7e8e3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1299 microversion: 2.1 time: 0.127010 Jun 15 14:58:22.552846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 192/372] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:22 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:22.666188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:22.666848 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:22.677763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.679098 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.681552 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:22.681552 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:22.945391 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:22.956122 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:22.957642 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:22.964018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7459c480-9e24-4c0f-b15e-df0a1e065df2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.304796 Jun 15 14:58:22.964618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 193/373] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:22 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:23.182752 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:23.182752 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:23.182923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-59fa42b5-4492-4288-9e4d-0b161abd0ca5 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "POST /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.436468 Jun 15 14:58:23.182923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 181/374] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 14:58:18 2022] POST /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17/os-volume_attachments => generated 194 bytes in 4439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:23.195938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.196403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.197187 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.197638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.244744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:23.245626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=18 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:23.452869 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:23.454416 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:23.474499 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.475941 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.479465 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.481815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.560748 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=8 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:23.711735 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.731994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c68af51a-2b90-467e-a2cc-7b5e43d6d63b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1371 microversion: 2.1 time: 0.558465 Jun 15 14:58:23.747029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 194/375] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:23 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:23.759002 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:23.759827 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:23.769603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.770257 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.771105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:23.771651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:23.957897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:23.972511 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-eb9e08a5-098a-46c8-9eb6-3a09fc85e27d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.527351 Jun 15 14:58:23.977715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 182/376] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:23 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:23.986897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:23.993422 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:24.022902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.027003 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.031478 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.035727 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.393256 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.406036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c5c060aa-52f8-4982-b6eb-2631cd3d1c27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.656976 Jun 15 14:58:24.407240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 195/377] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:23 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:24.525098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.535944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.537648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:24.539019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-675a9077-3970-4d44-997d-7e4efd0e6b61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.559964 Jun 15 14:58:24.553985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 183/378] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:23 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:24.756999 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:24.756999 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:24.762800 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.763260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.764050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:24.764499 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:24.992387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:24.993258 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.005174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.005686 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.030014 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.033981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.081306 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.100304 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3cff44e0-9876-4dce-ac2e-40372092da70 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1566 microversion: 2.1 time: 0.348463 Jun 15 14:58:25.100304 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 196/379] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:24 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1566 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:25.123534 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-00a2df1b-2aab-44cf-84c9-da245db77fa9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:25.127603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-00a2df1b-2aab-44cf-84c9-da245db77fa9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.146509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00a2df1b-2aab-44cf-84c9-da245db77fa9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.147705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00a2df1b-2aab-44cf-84c9-da245db77fa9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.148679 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00a2df1b-2aab-44cf-84c9-da245db77fa9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.149858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-00a2df1b-2aab-44cf-84c9-da245db77fa9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.381594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-00a2df1b-2aab-44cf-84c9-da245db77fa9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270525 Jun 15 14:58:25.383046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 197/380] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 14:58:25 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:25.424042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:25.424932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.436236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.441605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.460578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.466306 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.720745 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.730470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0cb571bf-2dae-4843-87c5-fd294c157695 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.743538 Jun 15 14:58:25.731058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 184/381] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:24 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:25.768953 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:25.770655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:25.779052 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.783130 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.784162 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:25.787684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:25.859710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:25.871104 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-14e06836-83f5-4051-944d-e7b24937a73b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.450954 Jun 15 14:58:25.874410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 198/382] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:25 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:26.439824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-b3308c01-a93b-4324-bf9a-b744aaa9b2f4 req-663213b8-67f7-4698-83bd-86eb373951e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db8069f-14f9-458c-984e-4c7e3ea32df0", "tag": "4e147639-36c4-40e4-b4e9-40be7f9e982c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:26.461176 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-b3308c01-a93b-4324-bf9a-b744aaa9b2f4 req-663213b8-67f7-4698-83bd-86eb373951e2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.462033 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-b3308c01-a93b-4324-bf9a-b744aaa9b2f4 req-663213b8-67f7-4698-83bd-86eb373951e2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.480088 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-b3308c01-a93b-4324-bf9a-b744aaa9b2f4 req-663213b8-67f7-4698-83bd-86eb373951e2 service nova] Creating event network-changed:4e147639-36c4-40e4-b4e9-40be7f9e982c for instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 on hv-cinder-84517 Jun 15 14:58:26.486968 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-b3308c01-a93b-4324-bf9a-b744aaa9b2f4 req-663213b8-67f7-4698-83bd-86eb373951e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051919 Jun 15 14:58:26.493629 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 199/383] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:26.709384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:26.721178 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:26.723765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:26.725264 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d6088862-5459-4cfa-bfc7-b47e337c097d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.977567 Jun 15 14:58:26.726026 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 185/384] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:25 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:26.748652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:26.750019 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:26.765688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.767515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.774954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.775665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.892771 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:26.893786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:26.914741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.915403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:26.916904 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:26.917460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.262122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:27.268686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:27.271826 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c3f6f92a-0281-4295-8e6a-3cceaff9e30a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.383842 Jun 15 14:58:27.280843 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c4b50f51-a2b6-4a83-a003-23039dc4dd79 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.536585 Jun 15 14:58:27.284650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 186/385] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:26 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:27.285133 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 200/386] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:26 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:27.745128 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:27.745755 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:27.758372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.759203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:27.761193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:27.761828 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.132190 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.158562 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.164062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.173569 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a47a4403-b70f-41c5-b1c9-796c7b5bd7d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.427267 Jun 15 14:58:28.175806 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 187/387] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:27 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:28.303186 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.306414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.308763 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:28.309585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:28.319251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.319994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.321796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.322451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.335317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.338646 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.339683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.342860 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.776263 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.784872 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-598801cf-02c1-40e2-b9d8-8d7a6317318b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.493662 Jun 15 14:58:28.785533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 201/388] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:28 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:28.791562 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-cda5f6dd-5636-44a7-84a3-6145c7c19fc1 req-90389184-b53e-484f-923a-3e7b3b9c6aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8490a7b-6956-4086-a14b-8d892496d608", "tag": "36d09c08-3dcb-4a3b-9fc2-a993412d350d"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:28.798951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:28.801038 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-cda5f6dd-5636-44a7-84a3-6145c7c19fc1 req-90389184-b53e-484f-923a-3e7b3b9c6aa4 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:28.801561 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-cda5f6dd-5636-44a7-84a3-6145c7c19fc1 req-90389184-b53e-484f-923a-3e7b3b9c6aa4 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:28.814634 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:28.822009 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-cda5f6dd-5636-44a7-84a3-6145c7c19fc1 req-90389184-b53e-484f-923a-3e7b3b9c6aa4 service nova] Creating event network-changed:36d09c08-3dcb-4a3b-9fc2-a993412d350d for instance e8490a7b-6956-4086-a14b-8d892496d608 on hv-cinder-84517 Jun 15 14:58:28.827705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-cda5f6dd-5636-44a7-84a3-6145c7c19fc1 req-90389184-b53e-484f-923a-3e7b3b9c6aa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040110 Jun 15 14:58:28.828110 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-66d5705d-d49b-4c6a-a959-e41fda9dd982 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.530150 Jun 15 14:58:28.828808 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 202/389] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:28.838201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 188/390] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:28 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:29.198812 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.200040 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.220545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.221433 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.223299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.225134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.694138 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.705943 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.714363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:29.719149 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6ccceddd-0e3a-49ba-ae4e-e7fa8b2a0b94 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.523088 Jun 15 14:58:29.720350 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 203/391] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:29 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:29.802923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.803539 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.823458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.831266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.836609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.838677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.849689 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:29.850493 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:29.861555 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.866784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:29.870985 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:29.871805 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.724245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.746807 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-642eeb76-c9d5-4ecb-858c-74dec0274f0d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.946328 Jun 15 14:58:30.749251 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 189/392] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:29 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:30.770616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:30.771264 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:30.785245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.786764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.787849 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:30.788877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:30.825701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:30.836644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b3e021c7-679b-4ef6-9bae-5dadb1aafd9d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.992055 Jun 15 14:58:30.844791 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 204/393] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:29 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:31.060919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:31.084590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:31.090908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:31.096096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7bc99a15-10df-4f8b-8017-a6dfb20d9b2b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.341244 Jun 15 14:58:31.100220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 190/394] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:30 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:31.767226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.768217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.780514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.781374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.782417 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.783156 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.794601 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:31.866492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:31.867040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:31.875139 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.888536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:31.890280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:31.890940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.079434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.097502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0fd75686-2e30-418d-981d-d1de12fdd452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.334145 Jun 15 14:58:32.100189 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 205/395] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:32.123560 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:32.124193 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:32.136795 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.137858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.138225 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:32.138769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:32.155552 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.168051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-243b7384-0ece-4175-aeb7-d2bc3573322f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.309023 Jun 15 14:58:32.172187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 191/396] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:31 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:32.418748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.432789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.441385 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:32.445018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e0f7f38b-12f7-4c6d-b3fc-f9ce3099d63c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.330102 Jun 15 14:58:32.480053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 206/397] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:32 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:33.116972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.117603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.124991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.125451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.130305 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.130892 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.257523 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-773c58db-5b9f-440b-82d2-767d809d3596 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Action: 'create', calling method: .version_select at 0x7f693af74160>, body: {"keypair": {"name": "tempest-TestShelveInstance-47818703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKH9ee8Gs77CuN++kdcdA5+fFaKMj4trgmIbgfnO3ctobIdc7x37qcRrtdbT+fnN6pIVW8RhNleFDRcnn7S2I/RanC3Xfkeitckdog9So0bruqc1j6y2UK3VqDLzaVWgw=="}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:33.288896 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-773c58db-5b9f-440b-82d2-767d809d3596 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Getting quotas for project 06d1766d477e4d3993d1474d6e1a30e6. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:58:33.297358 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-773c58db-5b9f-440b-82d2-767d809d3596 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Getting quotas for user 26608323a21f4cb7832b93bdfd971663 and project 06d1766d477e4d3993d1474d6e1a30e6. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:58:33.409931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-773c58db-5b9f-440b-82d2-767d809d3596 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.485861 Jun 15 14:58:33.410893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.411152 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 192/398] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 14:58:32 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:33.419554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-311b2088-e121-420b-980e-affd1dcd8492 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.306721 Jun 15 14:58:33.429637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.434748 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.434885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 207/399] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:33.438884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.439598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.440432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.440884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.488345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:33.490115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:33.506246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.506623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.508256 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:33.511291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:33.802835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.812200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.819481 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.825119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:33.831685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4fbac335-ca68-4b57-8d5e-5508accd501a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.348148 Jun 15 14:58:33.833002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-75cef334-dd0c-4fba-a7ee-106c0b62302a tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.420385 Jun 15 14:58:33.833750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 193/400] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:33.834844 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 208/401] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:33 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:34.440644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.441339 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.448703 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.449192 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.450122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.450690 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.630503 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:34.639335 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d791f51b-ec36-4595-9c81-2109ebd18f27 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.205370 Jun 15 14:58:34.639985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 194/402] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:34.851033 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.853205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.857090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:34.857696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:34.864780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.865124 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.865471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.865568 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.866364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.866471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:34.866803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:34.867207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.105143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.126374 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.126374 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.126870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-218bf9ee-3d97-499f-acd0-2fb0aa2ad092 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.274270 Jun 15 14:58:35.141404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 195/403] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:35.154950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.166579 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5f676d57-4b76-4d30-929a-43004fb3b799 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.319750 Jun 15 14:58:35.176762 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 209/404] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:34 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:35.666453 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:35.668597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:35.677506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.677964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.679901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:35.680575 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:35.943473 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:35.951223 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3fc9d7f7-636a-4fe5-a574-1f7315925ad2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.298087 Jun 15 14:58:35.962281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 196/405] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:35 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:36.151150 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:36.152082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:36.159584 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.160049 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.160988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.161510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.183602 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:36.184231 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:36.190772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.191721 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.192688 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.193289 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.365357 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:36.375864 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:36.377378 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:36.379913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c655c7ea-5e06-4d44-aa09-bd022e7294f1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.236074 Jun 15 14:58:36.386614 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:36.389720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 210/406] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:36 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:36.396509 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9d673f98-e2f7-4a9c-bd8d-f0b26e12ede0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.216851 Jun 15 14:58:36.404832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 197/407] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:36 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:36.968879 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:36.969733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:36.978964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.979682 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:36.980592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:36.981141 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.214477 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.222998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-594829db-25c7-45a0-b833-73bf702570fc tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.257301 Jun 15 14:58:37.232634 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 211/408] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:36 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:37.405532 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:37.406154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:37.415002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.415458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.416244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.416685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.418505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:37.419121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:37.427770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.428494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.429476 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:37.429917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:37.644036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.646342 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:37.654574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.656278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.656587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:37.657530 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d3aee521-2709-4996-abca-3004c5772180 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1740 microversion: 2.20 time: 0.256605 Jun 15 14:58:37.658578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 198/409] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:37 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:37.666753 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-90d1a3b8-25ad-4e7c-8055-42bccbdb2b9e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.252059 Jun 15 14:58:37.667342 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 212/410] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:37 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:38.240506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:38.241807 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:38.248913 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.249617 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.255193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.255193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.437343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:38.437343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d0070b9e-73a3-495a-a48d-569c8b0686eb tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.172767 Jun 15 14:58:38.437343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 199/411] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:38 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:38.677269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:38.677925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:38.684834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.684975 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:38.685331 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.685760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:38.686124 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.686585 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.693466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.693923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.694736 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:38.695176 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:38.906762 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:38.915409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:38.917292 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:38.918335 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:38.918486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-bcdb6582-c17b-41ae-a435-c61fe273bb4c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.245467 Jun 15 14:58:38.919004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 213/412] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:38 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:38.926862 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-62fa96ee-c194-4299-84fe-809be4266e0e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.245867 Jun 15 14:58:38.927415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 200/413] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:38 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:39.426968 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:39.427662 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:39.433630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.435744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.435744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.435744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.582925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:39.582925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b03e6c19-31f0-4e8b-8998-a7b66710b106 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.159853 Jun 15 14:58:39.583106 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 214/414] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:39 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:39.937999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:39.938683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:39.942429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:39.944453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:39.945113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:39.947443 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.947894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.948656 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.949085 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.951509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.951961 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:39.952724 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:39.953167 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.148317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:40.156756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:40.158527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:40.158663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:40.160538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-623e3103-55c5-448f-aaf5-046027c086d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.226378 Jun 15 14:58:40.161082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 201/415] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:39 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:40.168166 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8849b05e-0bc6-408f-854d-64e5040645b3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.228291 Jun 15 14:58:40.168942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 215/416] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:39 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:40.598624 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:40.599262 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:40.608097 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:40.608548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.609322 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:40.609758 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:40.748153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:40.748153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2fe14914-a028-4e34-a4e6-17c2d6f72d80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.152856 Jun 15 14:58:40.748153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 202/417] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:40 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:41.179524 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:41.180249 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:41.187923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:41.188848 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.188996 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:41.189642 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.191234 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.191887 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.215356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.219260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.221881 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.222988 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.541959 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:41.550696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:41.552925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:41.554130 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-983a7ba7-d8d4-433e-a5b7-8df97b72e7f3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.379352 Jun 15 14:58:41.554732 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 216/418] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:41 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:41.567290 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:41.567563 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-d9aeb157-1a34-46c9-9b48-d30e612a1d12 req-26456a19-2a6d-4eef-a510-15646f5076cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db8069f-14f9-458c-984e-4c7e3ea32df0", "name": "network-vif-plugged", "status": "completed", "tag": "4e147639-36c4-40e4-b4e9-40be7f9e982c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:41.567728 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-acb7f36a-e633-47de-9db7-bf09e0e630eb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.384353 Jun 15 14:58:41.568294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 203/419] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:41 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:41.570091 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d9aeb157-1a34-46c9-9b48-d30e612a1d12 req-26456a19-2a6d-4eef-a510-15646f5076cf service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.570727 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d9aeb157-1a34-46c9-9b48-d30e612a1d12 req-26456a19-2a6d-4eef-a510-15646f5076cf service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.593553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-d9aeb157-1a34-46c9-9b48-d30e612a1d12 req-26456a19-2a6d-4eef-a510-15646f5076cf service nova] Creating event network-vif-plugged:4e147639-36c4-40e4-b4e9-40be7f9e982c for instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 on hv-cinder-84517 Jun 15 14:58:41.599188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-d9aeb157-1a34-46c9-9b48-d30e612a1d12 req-26456a19-2a6d-4eef-a510-15646f5076cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043005 Jun 15 14:58:41.599992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 217/420] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:41.764732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:41.765410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:41.773360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.773957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.774776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:41.775278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:41.918141 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:41.926579 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-58a31a5c-a8aa-4895-b14d-50f12c4cef5e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.165576 Jun 15 14:58:41.927133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 204/421] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:41 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:42.573466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:42.574190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:42.581635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.594081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.594081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.594081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.594384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:42.594384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:42.594384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.594384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.595071 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.595071 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.789142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:42.792221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:42.797782 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:42.800344 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:42.801268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f272a719-e2bf-46db-8bfc-d0f9b1528da9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.219813 Jun 15 14:58:42.801558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-12227438-556e-4a84-91fa-5c79b35b6a6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.232906 Jun 15 14:58:42.801853 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 205/422] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:42 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:42.802102 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 218/423] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:42 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:42.943304 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:42.943907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:42.949837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.950314 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:42.951064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:42.951493 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.080480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:43.087824 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-962f5916-ba0f-4470-be1e-4661a5d823a1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.148848 Jun 15 14:58:43.088384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 206/424] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:42 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:43.629274 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-43169d73-de17-43b0-997f-749cc36c058c req-5a405d55-2597-4e6c-ad7a-e813da820288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6014d-9ea6-47c4-af6c-719e09d8d193", "name": "network-vif-unplugged", "status": "completed", "tag": "08f6804f-9163-46e0-a8a3-e6d5513b1c44"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:43.637716 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-43169d73-de17-43b0-997f-749cc36c058c req-5a405d55-2597-4e6c-ad7a-e813da820288 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.638153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-43169d73-de17-43b0-997f-749cc36c058c req-5a405d55-2597-4e6c-ad7a-e813da820288 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.649993 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-43169d73-de17-43b0-997f-749cc36c058c req-5a405d55-2597-4e6c-ad7a-e813da820288 service nova] Creating event network-vif-unplugged:08f6804f-9163-46e0-a8a3-e6d5513b1c44 for instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 on hv-cinder-84517 Jun 15 14:58:43.654870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-43169d73-de17-43b0-997f-749cc36c058c req-5a405d55-2597-4e6c-ad7a-e813da820288 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030251 Jun 15 14:58:43.655438 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 219/425] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:43.821823 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:43.822781 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:43.822884 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:43.823964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:43.825622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=4 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:43.834323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.841134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.841269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.841364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.841364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.841546 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:43.841632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:43.841716 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.051846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:44.055282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:44.060058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:44.061571 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:44.062763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4fd923c5-4d35-4448-ad0c-d0e092f8d307 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.246996 Jun 15 14:58:44.063242 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-31d3d2ef-ba42-439b-9688-fab2aea46442 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.248714 Jun 15 14:58:44.063360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 220/426] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:43 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:44.063795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 207/427] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:43 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:44.104661 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:44.105199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:44.111905 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:44.112358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.113122 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:44.113560 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:44.240260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:44.247575 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-66a23b95-77bb-4816-8a55-a8be756d806a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.146603 Jun 15 14:58:44.248195 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 221/428] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:44 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:45.080888 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:45.081406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:45.081764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:45.081859 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:45.088142 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.088289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.088592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.088697 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.089362 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.089461 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.089798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.089892 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.289811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.292849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.297895 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.300184 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.301432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2f7f9a68-3318-4407-8008-88cddb4d2bd5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.224539 Jun 15 14:58:45.301824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b0e49c69-21f9-4674-a5e6-5738e4265ee5 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.224889 Jun 15 14:58:45.302315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 208/429] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:45 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:45.302620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 222/430] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:45 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:45.306975 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:45.307587 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:45.314548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.315143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.315996 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:45.316460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:45.447100 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:45.455603 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-099b03be-d3d9-42b2-9f5e-3751a661de4b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.151924 Jun 15 14:58:45.456237 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 209/431] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:45 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:46.325678 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:46.326247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:46.326628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:46.326720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:46.333251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.333402 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.333706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.333955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.334527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.334871 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.334965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.335419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.339096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:46.532360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.539448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.541375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-38fa7b03-1a1c-442f-a102-b9eed7d6e31c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.223870 Jun 15 14:58:46.542014 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 210/432] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:46 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:46.547036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:46.547667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:46.547793 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.550415 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.551798 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6dd6dd79-999b-4439-81c2-93537225ad46 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.230183 Jun 15 14:58:46.552516 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 223/433] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:46 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:46.554905 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.555349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.556117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:46.556548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:46.689793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:46.697491 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-88c3cea4-1e8e-4eb7-9a19-6ddb62cb44e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.154392 Jun 15 14:58:46.698060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 211/434] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:46 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:47.559333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.559973 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:47.567269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.567851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.569093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.569703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.570228 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.571337 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:47.578012 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.578498 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.579277 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.579739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.769775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:47.772647 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:47.777951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-84fc9486-b71a-40bd-93e0-20cca8d5b964 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.222649 Jun 15 14:58:47.778555 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 224/435] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:47.784051 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:47.784395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:47.784656 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:47.786487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:47.787861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5811eded-888c-49bf-a93c-e0108b63e496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.221463 Jun 15 14:58:47.788649 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 212/436] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:47.790456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.790902 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.791662 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:47.792098 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:47.919013 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:47.926665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3c15ebe6-6e26-4013-a1d4-eff1c4f45af9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.147176 Jun 15 14:58:47.927225 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 225/437] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:47 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:48.795069 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:48.795682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:48.802341 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:48.802795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:48.803571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:48.804018 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:48.808972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:48.809621 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:48.817248 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:48.817694 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:48.818485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:48.818917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:49.000747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:49.005284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:49.009623 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-70c894e6-974a-4565-a125-490b1150bdeb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.218544 Jun 15 14:58:49.010211 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 213/438] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:48 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:49.013397 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:49.014578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:49.014934 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:49.015177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:49.016079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-93a34f43-8ce4-416c-b167-bf59f0720896 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.212627 Jun 15 14:58:49.020371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 226/439] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:48 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:49.021894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:49.022381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:49.023180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:49.023614 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:49.152529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:49.160782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-161f48a6-8b98-4782-89d8-7891670656aa tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.149625 Jun 15 14:58:49.161340 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 214/440] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:49 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:50.027397 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:50.028054 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:50.035880 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.036743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.037680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.038367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.042835 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:50.043460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:50.056081 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.056637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.057910 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.058484 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.081119 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:50.655850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:50.662203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:50.665152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4dbf1cde-0b9e-4f98-bf15-53fe0214bf0f tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.641390 Jun 15 14:58:50.665950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 227/441] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:50 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:50.670893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:50.671726 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:50.680399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:50.680550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.680550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.680725 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:50.680831 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:50.681099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:50.682104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d389476a-3db8-4fb9-9da6-7ae62085fe86 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1722 microversion: 2.20 time: 0.650701 Jun 15 14:58:50.683164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 215/442] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:50 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1722 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:50.821853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:50.829896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3599a2fc-742c-40fa-8b1c-5369f865d024 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.161966 Jun 15 14:58:50.830547 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 228/443] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:50 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:51.683200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:51.683848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:51.691554 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.692000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.692756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.693188 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.702082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:51.702841 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:51.712736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.714002 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.714873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.715315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.903812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:51.908732 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:51.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:51.918817 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:51.919988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-41b66b72-6056-44f4-8903-625738a9e2ce tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1725 microversion: 2.20 time: 0.221816 Jun 15 14:58:51.920592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 229/444] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:51 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:51.926352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:51.927050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:51.927295 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ef03db07-8e3d-4b10-9a73-6ef509a678fe tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1723 microversion: 2.1 time: 0.247153 Jun 15 14:58:51.933816 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.934671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.935453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.935895 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.937556 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 216/445] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:51 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:51.946042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-36a22dda-e5e4-4035-bb4d-4e56afaa375a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdc05669-d8ab-4bb8-984b-4450e966f663"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:51.950958 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-36a22dda-e5e4-4035-bb4d-4e56afaa375a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:51.953581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-36a22dda-e5e4-4035-bb4d-4e56afaa375a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.955137 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-36a22dda-e5e4-4035-bb4d-4e56afaa375a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:51.956294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-36a22dda-e5e4-4035-bb4d-4e56afaa375a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:51.956981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-36a22dda-e5e4-4035-bb4d-4e56afaa375a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:52.079583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:52.087139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f038cf95-3b36-425c-b51a-62e0d1c097b0 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1366 microversion: 2.1 time: 0.165424 Jun 15 14:58:52.087703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 230/446] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:51 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:52.945040 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:52.945657 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:52.952476 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:52.953196 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:52.954832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:52.955344 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.087204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:53.095858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ca07af59-be27-402d-94e1-6a0f8b47ef34 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1700 microversion: 2.1 time: 0.154877 Jun 15 14:58:53.096417 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 231/447] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:52 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:53.104473 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:53.105152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.111473 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.111932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.112695 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.113135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.152378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-36a22dda-e5e4-4035-bb4d-4e56afaa375a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.211699 Jun 15 14:58:53.153304 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 217/448] 10.222.0.23 () {62 vars in 1363 bytes} [Wed Jun 15 14:58:51 2022] POST /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments => generated 188 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 14:58:53.168159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-89c8876c-e2ca-470d-aec8-3ade9a086241 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:53.178793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89c8876c-e2ca-470d-aec8-3ade9a086241 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.179250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89c8876c-e2ca-470d-aec8-3ade9a086241 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.245513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-89c8876c-e2ca-470d-aec8-3ade9a086241 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Going to try to start instance {{(pid=124695) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 14:58:53.259337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:53.267961 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9521af77-99a4-4467-9c27-2077e785996a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1555 microversion: 2.1 time: 0.166814 Jun 15 14:58:53.268351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 232/449] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:53 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:53.284745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5872c806-f8c8-4157-9423-37b8db80b895 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:53.285200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5872c806-f8c8-4157-9423-37b8db80b895 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.291276 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5872c806-f8c8-4157-9423-37b8db80b895 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.291727 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5872c806-f8c8-4157-9423-37b8db80b895 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.292496 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5872c806-f8c8-4157-9423-37b8db80b895 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.292932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5872c806-f8c8-4157-9423-37b8db80b895 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.370616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5872c806-f8c8-4157-9423-37b8db80b895 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090047 Jun 15 14:58:53.371241 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 233/450] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 14:58:53 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:58:53.377581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8b2f1fb6-e82b-47b0-a970-ac7b8486d8d4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:53.377728 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8b2f1fb6-e82b-47b0-a970-ac7b8486d8d4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.383993 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b2f1fb6-e82b-47b0-a970-ac7b8486d8d4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.384425 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b2f1fb6-e82b-47b0-a970-ac7b8486d8d4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.385190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b2f1fb6-e82b-47b0-a970-ac7b8486d8d4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.385624 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b2f1fb6-e82b-47b0-a970-ac7b8486d8d4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.517674 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-89c8876c-e2ca-470d-aec8-3ade9a086241 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action" status: 202 len: 0 microversion: 2.1 time: 0.362751 Jun 15 14:58:53.518322 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 218/451] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 14:58:53 2022] POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:58:53.528133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:53.529055 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.538533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.539416 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.540204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.540675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.728203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:53.737503 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ad341d59-ed88-4fa5-b9bc-a8431e11bbda tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1709 microversion: 2.1 time: 0.214717 Jun 15 14:58:53.738432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 219/452] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:53 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1709 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:58:53.744137 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8b2f1fb6-e82b-47b0-a970-ac7b8486d8d4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/action" status: 202 len: 0 microversion: 2.20 time: 0.371794 Jun 15 14:58:53.744819 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 234/453] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Jun 15 14:58:53 2022] POST /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:58:53.754601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:53.755222 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:53.761284 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.761672 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.762590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:53.763200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:53.980048 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:53.992525 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:53.994892 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:53.996814 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5ba5c635-bf42-4897-a193-270811c18d17 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1811 microversion: 2.20 time: 0.247034 Jun 15 14:58:53.998521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 220/454] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:53 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1811 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:54.707408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-ea07d102-9a84-4bbe-9d86-e36281ed1873 req-4070bdc3-7af5-48b5-b0b8-f8311f75b266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db8069f-14f9-458c-984e-4c7e3ea32df0", "tag": "4e147639-36c4-40e4-b4e9-40be7f9e982c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:58:54.722098 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-ea07d102-9a84-4bbe-9d86-e36281ed1873 req-4070bdc3-7af5-48b5-b0b8-f8311f75b266 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:54.722986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-ea07d102-9a84-4bbe-9d86-e36281ed1873 req-4070bdc3-7af5-48b5-b0b8-f8311f75b266 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:54.741503 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-ea07d102-9a84-4bbe-9d86-e36281ed1873 req-4070bdc3-7af5-48b5-b0b8-f8311f75b266 service nova] Creating event network-changed:4e147639-36c4-40e4-b4e9-40be7f9e982c for instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 on hv-cinder-84517 Jun 15 14:58:54.749556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-ea07d102-9a84-4bbe-9d86-e36281ed1873 req-4070bdc3-7af5-48b5-b0b8-f8311f75b266 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046236 Jun 15 14:58:54.750889 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 235/455] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:58:54.758307 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:54.759407 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:54.768072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:54.769146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:54.771203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:54.771750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:54.944230 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:54.962780 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9cf71d19-7689-4026-8b25-dbc86fe94e78 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1709 microversion: 2.1 time: 0.210434 Jun 15 14:58:54.964241 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 221/456] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:54 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1709 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:55.018916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:55.019708 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:55.026321 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:55.027038 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:55.028265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:55.028265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:55.181531 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:55.190528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:55.192440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:55.193600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2f11c58b-30fd-40d1-aa61-2b45f8b5c4bf tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1811 microversion: 2.20 time: 0.180025 Jun 15 14:58:55.195211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 236/457] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:55 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1811 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:55.980772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:55.981509 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:55.989457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:55.989908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:55.996289 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:55.996289 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:56.129117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:56.137525 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-111927b7-a0f6-4fc9-9bca-a9b79001c1e8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1709 microversion: 2.1 time: 0.160704 Jun 15 14:58:56.138103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 222/458] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:55 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:56.213300 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:56.213959 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:56.222706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:56.223159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:56.223941 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:56.224442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:56.368410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:56.381508 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:56.383949 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:56.385206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-da7d74dd-5434-4e20-94b9-f42cf6f95b4e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1811 microversion: 2.20 time: 0.175901 Jun 15 14:58:56.385821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 237/459] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:56 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:57.155794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:57.156915 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:57.163889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.164434 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.165325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.165839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.400918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:57.403912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:57.404529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:57.409455 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d51ae673-bf30-4c55-9081-50ae5b773842 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1709 microversion: 2.1 time: 0.257503 Jun 15 14:58:57.410032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 223/460] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:57 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1709 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:57.412054 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.412504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.413268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:57.413701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:57.554370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:57.570006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:57.571669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:57.572837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2efcd14d-f751-4213-9696-0d0e17db2c0e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1811 microversion: 2.20 time: 0.173267 Jun 15 14:58:57.573890 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 238/461] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:57 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:58:58.428246 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:58.428946 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:58.436756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:58.438608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:58.439391 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:58.439824 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:58.592483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:58.593871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:58.601065 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:58.601630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:58.602499 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:58.603240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:58.711105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:58.720507 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1c0f16a2-a255-4aa4-af9e-d1bd4ed80996 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1709 microversion: 2.1 time: 0.296228 Jun 15 14:58:58.721084 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 224/462] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:58 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1709 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:58.789834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:58.792243 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:58:58.800389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:58.801901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:58.803089 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6ba03aae-14ec-4125-b67c-021986d55236 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1753 microversion: 2.20 time: 0.214734 Jun 15 14:58:58.803635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 239/463] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:58 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:58:59.738538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:59.739148 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:59.745774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.746249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:59.747008 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.747441 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:59.821477 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:58:59.822822 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:58:59.830454 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.831250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:59.831669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:58:59.832173 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:58:59.918030 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:59.926842 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-878ba6f9-4ac1-446d-85f9-80019c78be48 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1709 microversion: 2.1 time: 0.192122 Jun 15 14:58:59.927512 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 225/464] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:58:59 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1709 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:58:59.984304 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:59.993004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:59.994533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:58:59.995822 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d6e7cdef-4a37-47d4-bf06-51cd1008a6d8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1753 microversion: 2.20 time: 0.178667 Jun 15 14:58:59.996512 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 240/465] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:58:59 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:00.944089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:00.944697 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:00.951203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:00.951655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:00.953002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:00.953440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.015911 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:01.016549 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:01.023434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:01.023894 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.024667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:01.025103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:01.117029 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:01.125064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9f26f75b-bae6-4d25-84ff-d5c258af1dba tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1713 microversion: 2.1 time: 0.184930 Jun 15 14:59:01.125630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 226/466] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:00 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1713 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:01.178923 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:01.187682 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:01.189199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:01.190394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1ab5520f-450d-4e07-a6d1-3d2ba743d3db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1753 microversion: 2.20 time: 0.179564 Jun 15 14:59:01.190953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 241/467] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:01 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:02.208300 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:02.208913 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:02.215608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.216059 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.216831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:02.217268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:02.350304 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:02.359114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:02.360653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:02.361827 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9d23434d-c9ba-48df-a18d-e2edcfc54923 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1753 microversion: 2.20 time: 0.157476 Jun 15 14:59:02.362424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 227/468] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:02 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:03.380145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:03.380749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:03.383207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=82 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:03.387906 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.388349 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.389592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:03.390523 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:03.517783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:03.526042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:03.527586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:03.528763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-874635dd-2e1b-4367-8e2c-5893a949cc10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1753 microversion: 2.20 time: 0.152559 Jun 15 14:59:03.529393 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 242/469] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:03 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:04.547601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:04.548236 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:04.554921 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:04.555375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:04.556141 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:04.556584 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:04.571826 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:04.692148 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:04.700617 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:04.702969 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:04.704221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f3b4c62e-655f-48a9-b571-a355057bea61 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.161110 Jun 15 14:59:04.704765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 228/470] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:04 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:04.931336 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:04.931951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:04.939675 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:04.940125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:04.940893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:04.941344 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:05.069867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lazy-loading 'services' on Instance uuid 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:59:05.367111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9fa2893d-a251-4d12-a9ab-4257c0060885 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17/os-volume_attachments/e69717c1-8644-4a9a-a269-c89a61e76398" status: 202 len: 0 microversion: 2.1 time: 0.439520 Jun 15 14:59:05.367700 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 243/471] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 14:59:04 2022] DELETE /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17/os-volume_attachments/e69717c1-8644-4a9a-a269-c89a61e76398 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 14:59:05.724296 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:05.725218 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:05.736286 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:05.736938 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:05.738071 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:05.738761 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:05.882471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:05.890885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:05.892394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:05.893542 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a52f9af1-2846-47f3-a838-a0b2cc03c3bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.174263 Jun 15 14:59:05.894090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 229/472] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:05 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:06.912236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:06.912930 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:06.919670 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:06.920942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:06.921713 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:06.922188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:07.056097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:07.065195 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:07.066719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:07.067869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e23c2ffa-763e-48ae-a150-791f72e25eed tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.159927 Jun 15 14:59:07.068408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 244/473] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:06 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:08.085994 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:08.086559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:08.094706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:08.095152 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:08.095904 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:08.096335 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:08.222579 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:08.231025 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:08.233118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:08.234299 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-be062dcb-be57-481d-8d38-a17afab184d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.152189 Jun 15 14:59:08.234849 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 230/474] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:08 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:09.252021 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:09.252560 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:09.259195 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:09.259650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:09.260418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:09.260861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:09.478026 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:09.488401 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:09.490136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:09.491468 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b3dd1ad5-4bf4-4fa2-a2da-d1bd29ef0481 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.243450 Jun 15 14:59:09.492171 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 245/475] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:09 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:10.513243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:10.514550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:10.521256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:10.521743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:10.522534 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:10.523079 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:10.723180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:10.737964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:10.750305 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:10.752516 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9417d42f-0a21-490a-af12-ba1b29f7ab39 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.246233 Jun 15 14:59:10.761883 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:10.764188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:10.765462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 231/476] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:10 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:10.772497 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:10.773343 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:10.774352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:10.775078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:10.815672 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:59:11.283706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-aebb482f-d212-41fd-896a-9a93e254ca4e tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 204 len: 0 microversion: 2.1 time: 0.530590 Jun 15 14:59:11.285369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 246/477] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 14:59:10 2022] DELETE /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:59:11.293840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:11.301621 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:11.304347 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=62 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:11.309389 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:11.310410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:11.311777 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:11.312216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:11.462968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:11.471960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-216125ea-74c4-4172-8e87-607b280c2fd9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.182550 Jun 15 14:59:11.472542 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 232/478] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:11 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:11.772294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:11.773035 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:11.780698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:11.781144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:11.781909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:11.782405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:11.913196 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:11.921785 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:11.923327 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:11.924485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a203fd88-0957-4d3a-95a1-4f0190c609ca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.156504 Jun 15 14:59:11.925034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 247/479] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:11 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:12.490346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:12.490956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:12.498132 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:12.498608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:12.499385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:12.499829 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:12.649438 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:12.658765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8996226b-082c-450f-b2ec-94ecf748b57a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.172409 Jun 15 14:59:12.659829 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 233/480] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:12 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:12.942386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:12.942992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:12.949537 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:12.950088 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:12.951679 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:12.952121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:13.085774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:13.094541 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:13.096033 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:13.097211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a101b9f1-5c24-4114-8e24-f3b0399e1230 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.158746 Jun 15 14:59:13.097758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 248/481] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:12 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:13.676840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:13.677464 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:13.684193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:13.684645 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:13.685423 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:13.685859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:13.827284 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:13.834760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f15d8a8a-1581-459f-a0f6-525274e35321 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.161788 Jun 15 14:59:13.835326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 234/482] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:13 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:14.115758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:14.116370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:14.123050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.123502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:14.124270 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.124710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:14.262990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:14.272048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:14.274490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:14.275690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-82161a6e-6233-4dbc-be85-3320fadf1500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.163754 Jun 15 14:59:14.276690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 249/483] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:14 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:14.852694 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:14.853329 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:14.860655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.861103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:14.861889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:14.862345 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:14.996020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:15.005224 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-33d55f91-53d5-4c8e-b1ce-dae12f9f45f6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.156335 Jun 15 14:59:15.015761 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 235/484] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:14 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:15.297115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:15.297925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:15.304680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:15.305127 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:15.305883 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:15.306350 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:15.439121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:15.447405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:15.448899 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:15.450586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4d50c4ea-8ada-45ed-a4b3-17adf51b4b77 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.158382 Jun 15 14:59:15.451139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 250/485] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:15 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:16.022911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:16.023526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:16.030678 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:16.031132 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:16.031891 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:16.032326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:16.167844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:16.175935 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cd69cc91-a912-41a0-a7ad-a95631d53cae tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.156853 Jun 15 14:59:16.176702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 236/486] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:16 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:16.469297 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:16.469920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:16.476883 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:16.477423 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:16.478328 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:16.478838 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:16.647622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:16.657181 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:16.658969 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:16.660369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a63c5e87-0233-4046-8506-79286b2d62bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.195588 Jun 15 14:59:16.660881 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 251/487] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:16 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:17.193081 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:17.193708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:17.200777 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:17.201227 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:17.202074 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:17.202541 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:17.330711 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:17.338814 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7b244455-bba3-4a8a-a324-273a9b5212c2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.149438 Jun 15 14:59:17.339539 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 237/488] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:17 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:17.679776 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:17.680337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:17.687658 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:17.688112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:17.688888 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:17.689327 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:17.820368 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:17.829353 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:17.830904 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:17.832056 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d690bc2f-9a0c-4521-a769-ca09a7859a22 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.156400 Jun 15 14:59:17.832614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 252/489] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:17 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:18.360082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:18.360666 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:18.368475 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:18.369124 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:18.370195 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:18.370637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:18.529906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:18.540136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bc75aeda-4989-4c8e-90b9-072cbdcd749a tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.184660 Jun 15 14:59:18.540722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 238/490] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:18 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:18.851405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:18.852034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:18.858893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:18.859344 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:18.860109 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:18.860546 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:18.988143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:18.997225 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:18.998804 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:18.999966 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-34f5973b-5a69-405f-b84c-ceb593404dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.152514 Jun 15 14:59:19.000525 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 253/491] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:18 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:19.557090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:19.557813 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:19.571369 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:19.571822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:19.572630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:19.573147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:19.577027 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1411098233", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-47818703", "security_groups": [{"name": "tempest-secgroup-smoke-1823823397"}], "networks": [{"uuid": "9fe1efd6-3c4e-421a-969c-9080c2f839b3"}], "block_device_mapping_v2": [{"uuid": "8b86024c-aaaa-4517-9f5a-3dbc0dffc635", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:19.733001 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] validate_networks() for [('9fe1efd6-3c4e-421a-969c-9080c2f839b3', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:59:19.842795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:19.851192 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-fe451295-5455-4a94-a8ea-273d436b235f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.297796 Jun 15 14:59:19.856679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 239/492] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:19 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:20.019362 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:20.020048 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:20.026438 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:20.026897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:20.027969 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:20.028418 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:20.370073 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:20.386596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:20.388445 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:20.389881 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-29fcdadd-15d0-4bb9-be23-242bcef5ae29 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.374584 Jun 15 14:59:20.390696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 240/493] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:20 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:20.484221 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:59:20.484854 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:59:20.485132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:59:20.485647 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:59:20.486114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:59:20.497770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:20.497918 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:20.499651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:20.500292 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:20.510200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:20.521423 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Getting quotas for project 06d1766d477e4d3993d1474d6e1a30e6. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:59:20.527460 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Getting quotas for user 26608323a21f4cb7832b93bdfd971663 and project 06d1766d477e4d3993d1474d6e1a30e6. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:59:20.599946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:59:20.602363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b86024c-aaaa-4517-9f5a-3dbc0dffc635',volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:59:20.873053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:20.873730 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:20.879949 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:20.880402 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:20.881175 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:20.881610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:21.031440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:21.049055 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c6b59fa2-5623-44b9-816d-9914247464a7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.180025 Jun 15 14:59:21.050746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 241/494] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:20 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:21.244162 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6fa066a1-ecf7-4e52-8bdd-7ef7d3b8bdf0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.671607 Jun 15 14:59:21.245142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 254/495] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:59:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 14:59:21.255244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-98c104a4-012f-491a-9a0d-34ea8d19f84c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:21.255958 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-98c104a4-012f-491a-9a0d-34ea8d19f84c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:21.329364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-98c104a4-012f-491a-9a0d-34ea8d19f84c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:21.336764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-98c104a4-012f-491a-9a0d-34ea8d19f84c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1087 microversion: 2.1 time: 0.085232 Jun 15 14:59:21.337897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 242/496] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:21 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:21.409735 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:21.410809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:21.421468 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:21.421958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:21.422930 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:21.423377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:21.613788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:21.613788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:21.614570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:21.614570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f245c509-db5d-4cb6-85b1-5a00870638aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.193272 Jun 15 14:59:21.614570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 255/497] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:21 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:22.067595 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:22.068212 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:22.077172 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:22.077960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:22.079151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:22.079924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:22.232295 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:22.239888 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b08582fb-0bd8-442e-b683-7be394b7e891 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.177373 Jun 15 14:59:22.240452 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 243/498] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:22 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:22.353766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c518f614-95a1-4c4b-a5e6-36338bbb9394 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:22.354403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c518f614-95a1-4c4b-a5e6-36338bbb9394 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:22.418004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c518f614-95a1-4c4b-a5e6-36338bbb9394 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:22.425079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c518f614-95a1-4c4b-a5e6-36338bbb9394 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1087 microversion: 2.1 time: 0.074972 Jun 15 14:59:22.425991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 256/499] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:22 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:22.631057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:22.631786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:22.646303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:22.647397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:22.648917 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:22.649748 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:22.855912 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:22.865034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:22.866806 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:22.868073 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9d558e62-0187-4a9c-b5ef-fbf19bd2a7f5 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.241835 Jun 15 14:59:22.868882 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 244/500] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:22 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:23.256946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:23.257664 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:23.266049 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:23.266550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:23.267356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:23.267804 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:23.444792 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:23.445442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:23.453001 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:23.453447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:23.454266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:23.454744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:23.463428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:23.471373 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c702c9b1-fd2b-4cb2-a171-dfa16b337697 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.218254 Jun 15 14:59:23.472112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 257/501] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:23 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:23.519375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:23.527796 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-11391f01-1867-4e8f-8003-feb403ccc2b8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1137 microversion: 2.1 time: 0.085792 Jun 15 14:59:23.528363 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 245/502] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:23 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:23.890877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:23.891482 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:23.897534 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:23.897979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:23.898771 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:23.899204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:24.033394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:24.043615 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:24.050917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:24.050917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-159376f4-6bf1-47b4-b2e0-8446248c0c02 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.159749 Jun 15 14:59:24.050917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 258/503] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:23 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:24.491113 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:24.491734 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:24.498402 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:24.498852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:24.499625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:24.500066 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:24.503989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:24.543837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:24.544453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:24.551412 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:24.551876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:24.552768 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:24.553211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:24.622255 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:24.630080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-672e846c-0634-4a5f-bc39-7ee96a1eb16a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1137 microversion: 2.1 time: 0.090105 Jun 15 14:59:24.636177 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 259/504] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:24 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:24.662634 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:24.674312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-77e7b73c-cda9-4603-9c30-38710fd0a528 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.187045 Jun 15 14:59:24.675090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 246/505] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:24 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:25.069819 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:25.070381 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:25.076673 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:25.077139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:25.077922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:25.078394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:25.219006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:25.227513 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:25.229006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:25.230962 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b653af24-96b5-4de3-8108-18a40c95719b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.165175 Jun 15 14:59:25.231507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 260/506] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:25 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:25.652596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:25.672625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:25.672625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:25.672625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:25.672625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:25.673061 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:25.693285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:25.693893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:25.700290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:25.700744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:25.701514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:25.701950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:25.722032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:25.730460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0aff9afd-6e58-4f71-a118-4c20bd51387e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1137 microversion: 2.1 time: 0.081767 Jun 15 14:59:25.731203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 247/507] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:25 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:25.841763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:25.849551 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4ba6eb8e-04bd-4d30-b9a9-663a33694945 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.160536 Jun 15 14:59:25.850126 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 261/508] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:25 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:26.249902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:26.250542 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:26.256500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:26.265963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:26.265963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:26.265963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:26.393101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:26.401985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:26.403656 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:26.404806 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-aa829654-af2f-43e6-8c9d-c77f48e02965 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.159827 Jun 15 14:59:26.405364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 248/509] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:26 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:26.747697 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:26.748403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:26.754975 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:26.762747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:26.762747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:26.762747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:26.816773 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:26.824458 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-56c4e5a1-00b7-4344-9440-ebc5f4f6d55e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1137 microversion: 2.1 time: 0.081218 Jun 15 14:59:26.825014 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 262/510] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:26 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:26.869174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:26.890622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:26.890622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:26.890622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:26.890622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:26.891027 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:27.010570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:27.018260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-39c91437-47c2-4cb0-a231-8e42d2590deb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.153451 Jun 15 14:59:27.018837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 249/511] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:26 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:27.423480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:27.424098 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:27.430132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:27.430619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:27.431478 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:27.431922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:27.587203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:27.587203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:27.587497 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:27.588409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-dba0958f-785d-4e6a-82b7-a6408d59564b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.168788 Jun 15 14:59:27.588988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 263/512] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:27 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:27.841876 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:27.842435 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:27.848849 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:27.849296 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:27.850065 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:27.850536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:27.927505 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:27.935953 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-89045814-cd34-446c-8f1c-b12942deeef3 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1129 microversion: 2.1 time: 0.098647 Jun 15 14:59:27.936527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 250/513] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:27 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1129 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:28.036403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:28.037064 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:28.045032 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:28.054989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:28.054989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:28.054989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:28.263869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:28.271329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b10f34b2-e5f3-4a19-b5e5-9bc2b3dadab7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1514 microversion: 2.1 time: 0.238868 Jun 15 14:59:28.271975 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:28 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:28.533599 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-17ff737e-4597-4a01-8f54-cb26048a57bc req-c54a8d3a-da72-4ca2-9a71-2bffa429a0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd8ef1d-c5d2-429c-839b-cb3e236bbb17", "name": "network-vif-deleted", "tag": "c95a6e62-c8ac-4e01-b99e-c17859e54779"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:28.542963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-17ff737e-4597-4a01-8f54-cb26048a57bc req-c54a8d3a-da72-4ca2-9a71-2bffa429a0fd service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:28.543408 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-17ff737e-4597-4a01-8f54-cb26048a57bc req-c54a8d3a-da72-4ca2-9a71-2bffa429a0fd service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:28.554634 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-17ff737e-4597-4a01-8f54-cb26048a57bc req-c54a8d3a-da72-4ca2-9a71-2bffa429a0fd service nova] Creating event network-vif-deleted:c95a6e62-c8ac-4e01-b99e-c17859e54779 for instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 on hv-cinder-84517 Jun 15 14:59:28.560153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-17ff737e-4597-4a01-8f54-cb26048a57bc req-c54a8d3a-da72-4ca2-9a71-2bffa429a0fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Jun 15 14:59:28.560729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 251/515] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:28.607626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:28.608322 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:28.614550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:28.615018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:28.615776 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:28.616218 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:28.753223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:28.762571 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:28.764084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:28.765230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8ab9b726-2cca-430b-bcf2-2e9a65978147 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.162381 Jun 15 14:59:28.765783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 265/516] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:28 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:28.956484 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:28.957162 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:28.963719 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:28.964301 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:28.965066 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:28.965510 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:29.026792 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:29.034138 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-624173d8-0b29-44fc-b4f4-e1ca7ab9660a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1185 microversion: 2.1 time: 0.082368 Jun 15 14:59:29.034727 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 252/517] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:28 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:29.288837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:29.289386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:29.295677 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:29.296158 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:29.296925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:29.297360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:29.364068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:29.372151 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c665fc69-1d14-4d3e-81cb-75ca6db2dab4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1472 microversion: 2.1 time: 0.087343 Jun 15 14:59:29.372711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 266/518] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:29 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:29.783502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:29.784102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:29.790068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:29.790545 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:29.791520 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:29.792495 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:29.922545 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:29.930864 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:29.932880 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:29.934029 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9d9c323d-4598-44e0-9a3b-37d01caae6db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.154468 Jun 15 14:59:29.934611 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 253/519] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:29 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:30.050850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:30.051469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:30.058722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:30.059178 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:30.061588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:30.061588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:30.121606 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:30.129095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fb994b7e-60a4-4bdb-9f6d-db3fffff9a8f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1185 microversion: 2.1 time: 0.082141 Jun 15 14:59:30.129663 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 267/520] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:30 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:30.392361 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:30.392914 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:30.401176 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:30.401641 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:30.402440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:30.402879 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:30.464976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:30.472428 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-caacb9cb-703c-45f1-87cd-f9961c56398f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1472 microversion: 2.1 time: 0.084150 Jun 15 14:59:30.474974 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 254/521] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:30 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1472 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:30.959668 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:30.960275 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:30.962113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:30.967713 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:30.968163 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:30.968924 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:30.969360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:31.109845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:31.118445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:31.120357 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:31.121523 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e97b30a6-823c-41bd-9961-8347525e0940 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.165743 Jun 15 14:59:31.122115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 268/522] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:30 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:31.146163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:31.146811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:31.153743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:31.154250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:31.155060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:31.155549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:31.218854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:31.226466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7714df57-fee2-4dfa-adb7-a34258df6c03 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1185 microversion: 2.1 time: 0.084189 Jun 15 14:59:31.227031 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 255/523] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:31 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:31.489755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:31.490479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:31.498032 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:31.498621 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:31.499420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:31.499865 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:31.536069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:31.536528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:31.536995 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lazy-loading 'fault' on Instance uuid 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:59:31.586824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:31.595210 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-15cd24cc-eff9-4c4f-a29b-ad608e94871b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1309 microversion: 2.1 time: 0.109420 Jun 15 14:59:31.596100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 269/524] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:31 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:32.208330 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:32.208330 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:32.208330 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:32.208330 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:32.209249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:32.209249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:32.209249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:32.243900 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:32.244690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:32.251217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:32.251677 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:32.252725 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:32.253166 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:32.326082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:32.333644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-eb472fc4-7e2f-477b-86be-92894ad7bb91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1203 microversion: 2.1 time: 0.093760 Jun 15 14:59:32.334231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 270/525] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:32 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1203 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:32.342901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:32.351275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:32.352765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:32.355359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7681f492-2852-4859-ac1f-f39e1e2749f4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.219132 Jun 15 14:59:32.355909 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 256/526] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:32 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:32.612955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:32.613617 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:32.615619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=8 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:32.621017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:32.621471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:32.622285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:32.622729 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:32.655659 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:32.656112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:32.656572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lazy-loading 'fault' on Instance uuid 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:59:32.697835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:32.699997 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:32.705979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-36e83fc1-edd6-4264-a59d-6c4d666c3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 200 len: 1309 microversion: 2.1 time: 0.097008 Jun 15 14:59:32.706569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 271/527] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:32 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:33.359025 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:33.360150 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:33.367597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:33.368685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:33.370788 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:33.371228 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:33.375575 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:33.378299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:33.396128 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:33.396851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:33.400664 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:33.401779 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:33.688114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:33.698055 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-48108d95-0235-4f3f-a3a3-2be668666df8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1271 microversion: 2.1 time: 0.349553 Jun 15 14:59:33.698771 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 257/528] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:33 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1271 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:33.722128 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:33.722761 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:33.730500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:33.733758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:33.737479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:33.738384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:33.739020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:33.744807 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:33.746463 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:33.748239 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-26a413a1-cd3a-4a7a-b8af-2ea853198f43 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.379107 Jun 15 14:59:33.758202 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 272/529] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:33 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] HTTP exception thrown: Instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 could not be found. Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Request method failure captured: Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 HTTP/1.1 Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfNVlTL0hQecZQZzRqcvDMJIenRrL0zNFm31ZbkUBRpP5suH6nRrxsuLEKq2nNwbkjmRKkO0PwPoZ4ytOUZk1siCU5DxQ8QADcVCmtCb5rgZM78ZWD8bVe_RTF5-I2F-HWtEGYUIvLF1GUYjkoWSL6LFnIbkK_zQDi4bNJSxLS7W_Zo Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 421ba5fd9c9d4ea0b3b3dd89069aabb2 Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1182676647 Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 14:59:33.758371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesSnapshotTestJSON-1182676647 Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 421ba5fd9c9d4ea0b3b3dd89069aabb2 Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1182676647 Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesSnapshotTestJSON-1182676647-project Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: 4e9c4ff3d13d4332837f519214b9df37 Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesSnapshotTestJSON-1182676647-project Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 could not be found. Jun 15 14:59:33.760325 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '7dd8ef1d-c5d2-429c-839b-cb3e236bbb17'} Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 could not be found. Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:59:33.761169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 could not be found. Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 could not be found. Jun 15 14:59:33.763487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:33.765886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Returning 404 to user: Instance 7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:59:33.765886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e9da8e26-57b4-491c-8d1d-9949857815e9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17" status: 404 len: 111 microversion: 2.1 time: 0.038849 Jun 15 14:59:33.765886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 258/530] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:33 2022] GET /compute/v2.1/servers/7dd8ef1d-c5d2-429c-839b-cb3e236bbb17 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 14:59:34.414858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-fb300d49-69ca-4505-997a-3c9568e0704d req-d5e7af01-ea51-4c11-9d69-0b449e311f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0407de-1fe3-40c9-92ff-a14f1a81f985", "tag": "e4963401-4f83-4506-b6d9-cef4682f75eb"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:34.424062 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:34.426763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-fb300d49-69ca-4505-997a-3c9568e0704d req-d5e7af01-ea51-4c11-9d69-0b449e311f0f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:34.427207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-fb300d49-69ca-4505-997a-3c9568e0704d req-d5e7af01-ea51-4c11-9d69-0b449e311f0f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:34.439501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-fb300d49-69ca-4505-997a-3c9568e0704d req-d5e7af01-ea51-4c11-9d69-0b449e311f0f service nova] Creating event network-changed:e4963401-4f83-4506-b6d9-cef4682f75eb for instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 on hv-cinder-84517 Jun 15 14:59:34.444505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-fb300d49-69ca-4505-997a-3c9568e0704d req-d5e7af01-ea51-4c11-9d69-0b449e311f0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039818 Jun 15 14:59:34.445267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 273/531] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:34.716032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:34.716648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:34.723477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:34.724149 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:34.725213 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:34.725807 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:34.779402 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:34.780542 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:34.799644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:34.799644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:34.799644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:34.799644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:34.961096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:34.969786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cb8bf6eb-7a9c-4a92-8385-7691a363ac25 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.258246 Jun 15 14:59:34.970464 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 259/532] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:34 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:34.987942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:34.996658 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:34.998153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:34.999455 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-216dea69-9aa8-402e-8184-ddcc549a5b5f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.233696 Jun 15 14:59:35.000018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 274/533] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:34 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:35.992331 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:35.992978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:36.000009 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:36.000644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:36.001422 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:36.001961 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:36.019440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:36.020237 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:36.027737 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:36.028272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:36.029145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:36.029788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:36.193677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:36.205503 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-65777b83-600f-49a7-a5fe-81a796444c81 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.216939 Jun 15 14:59:36.206590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 260/534] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:35 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:36.218817 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:36.227975 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:36.229981 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:36.231359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e701d33e-b12e-4ac8-b2fb-3554bdafbb55 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.216661 Jun 15 14:59:36.231939 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 275/535] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:36 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:36.526144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a96674b1-6bf5-49bc-8bc2-1bb72d28e366 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b34a2b06-f3a4-43f0-b9be-29d43959e90c"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:36.527310 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a96674b1-6bf5-49bc-8bc2-1bb72d28e366 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:36.533501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a96674b1-6bf5-49bc-8bc2-1bb72d28e366 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:36.533952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a96674b1-6bf5-49bc-8bc2-1bb72d28e366 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:36.534736 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a96674b1-6bf5-49bc-8bc2-1bb72d28e366 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:36.535477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a96674b1-6bf5-49bc-8bc2-1bb72d28e366 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:37.222809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:37.223441 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:37.230850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:37.231296 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:37.232050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:37.232480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:37.361465 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:37.369186 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fa3fbe1b-9c6b-4d43-a63e-f8c619c7b420 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.150512 Jun 15 14:59:37.369748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 276/536] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:37 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:37.374270 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:37.374875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:37.381387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:37.381906 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:37.382737 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:37.383175 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:37.512235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:37.520672 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:37.522199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:37.523356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-80643673-84fd-4425-b810-60884e54b350 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.152668 Jun 15 14:59:37.523928 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 277/537] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:37 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:38.385453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:38.386092 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:38.392460 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:38.392912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:38.393677 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:38.394238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:38.531448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:38.539326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6b208ccd-3580-4677-a528-cb02518f4811 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.157983 Jun 15 14:59:38.548976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 278/538] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:38 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:38.548976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:38.548976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:38.552305 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:38.552797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:38.553565 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:38.554031 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:38.608847 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a96674b1-6bf5-49bc-8bc2-1bb72d28e366 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.086612 Jun 15 14:59:38.609797 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 261/539] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 14:59:36 2022] POST /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments => generated 194 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:38.700984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:38.709755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:38.711309 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:38.713046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-339e2002-4bbd-4a5c-81e4-7165347f6986 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.170871 Jun 15 14:59:38.713599 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 279/540] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:38 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:39.558146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:39.558871 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:39.565039 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:39.565502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:39.566400 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:39.566840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:39.701868 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:39.704359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:39.710770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-22e30f6b-f072-42b1-ba4f-4f5655796d0f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.157981 Jun 15 14:59:39.711425 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 262/541] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:39 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:39.731606 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:39.732764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:39.739325 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:39.740977 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:39.740977 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:39.740977 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:39.807799 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-5c59f555-2d71-4b39-879e-1ed82ad78991 req-241d70e3-f392-49da-a429-ccc4e1506bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6014d-9ea6-47c4-af6c-719e09d8d193", "name": "network-vif-plugged", "status": "completed", "tag": "08f6804f-9163-46e0-a8a3-e6d5513b1c44"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:39.816407 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-5c59f555-2d71-4b39-879e-1ed82ad78991 req-241d70e3-f392-49da-a429-ccc4e1506bb8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:39.817222 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-5c59f555-2d71-4b39-879e-1ed82ad78991 req-241d70e3-f392-49da-a429-ccc4e1506bb8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:39.828992 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-5c59f555-2d71-4b39-879e-1ed82ad78991 req-241d70e3-f392-49da-a429-ccc4e1506bb8 service nova] Creating event network-vif-plugged:08f6804f-9163-46e0-a8a3-e6d5513b1c44 for instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 on hv-cinder-84517 Jun 15 14:59:39.833867 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-5c59f555-2d71-4b39-879e-1ed82ad78991 req-241d70e3-f392-49da-a429-ccc4e1506bb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029880 Jun 15 14:59:39.834546 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 263/542] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:39.877171 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:39.886680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:39.888510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:39.889909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d41ab42f-a6fa-4134-a8e0-92091b9b53df tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.162540 Jun 15 14:59:39.890544 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 280/543] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:39 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:40.729795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:40.730457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:40.737459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:40.739200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:40.739200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:40.739401 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:40.909333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:40.910143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:40.931877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:40.932334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:40.933715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:40.934400 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:40.956958 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:40.965282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3fd0eff1-4f93-4c68-b3c1-c7214440aaa2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.240586 Jun 15 14:59:40.966188 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 264/544] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:40 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:41.069052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:41.077765 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:41.079314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:41.080468 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8a865a03-67cc-473f-b718-caa3b27d0dd2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.175419 Jun 15 14:59:41.081029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 281/545] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:40 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:41.982767 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:41.983442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:41.986105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=68 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:41.991385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:41.991838 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:41.993267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:41.993902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:42.099808 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:42.100583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:42.107947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:42.108402 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:42.109190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:42.109628 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:42.453394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:42.457329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:42.461297 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c9140ded-77e2-4dea-a45d-50a524a6cdf7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.483221 Jun 15 14:59:42.462081 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 265/546] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:41 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:42.465932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:42.467486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:42.468648 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e230ed79-ef70-4f5b-a20d-f70a8ed8ab8e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.372867 Jun 15 14:59:42.469187 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 282/547] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:42 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 14:59:43.478520 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:43.479133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:43.486215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:43.486670 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:43.487436 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:43.487875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:43.487986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:43.488576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:43.496009 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:43.496464 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:43.497230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:43.497668 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:43.682993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:43.690770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:43.690980 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-575beabb-00cc-4097-b15c-ed470580607c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.216466 Jun 15 14:59:43.691655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 266/548] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:43 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:43.700267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:43.701779 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:43.702980 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-122d7f31-de47-49f8-8c7b-096132e88da6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.218859 Jun 15 14:59:43.703530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 283/549] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:43 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:44.693496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1366405500", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "networks": [{"uuid": "12f1a50d-27b9-4151-9ccf-726bf161f3d8"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:44.707956 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:44.708564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:44.715236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:44.715777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:44.716444 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:44.716882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:44.747170 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] validate_networks() for [('12f1a50d-27b9-4151-9ccf-726bf161f3d8', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 14:59:44.939929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:44.948412 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-577cb81f-2473-40db-abe6-f9867bb4c53e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.244236 Jun 15 14:59:44.950228 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 284/550] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:44 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:44.954990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:44.955916 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:44.962669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:44.963117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:44.963885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:44.964319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:45.184453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:45.192794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:45.194311 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:45.196054 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fbcf3534-3b27-4053-a4f5-d62d878b8c54 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.244241 Jun 15 14:59:45.196600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 285/551] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:44 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:45.236924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 14:59:45.237344 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 14:59:45.237813 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 14:59:45.238250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 14:59:45.238697 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 14:59:45.248298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:45.248741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:45.249527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:45.249955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:45.267170 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Getting quotas for project 421ba5fd9c9d4ea0b3b3dd89069aabb2. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 14:59:45.271062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Getting quotas for user 4e9c4ff3d13d4332837f519214b9df37 and project 421ba5fd9c9d4ea0b3b3dd89069aabb2. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 14:59:45.282025 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 14:59:45.284271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 14:59:45.434787 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ff292604-ad1c-43c6-a29d-42a35114d004 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744948 Jun 15 14:59:45.435627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 267/552] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 14:59:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 14:59:45.445773 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eb50603a-b72e-4e38-a148-ea95c81de9e1 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:45.446498 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-eb50603a-b72e-4e38-a148-ea95c81de9e1 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:45.504694 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-eb50603a-b72e-4e38-a148-ea95c81de9e1 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:45.511885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-eb50603a-b72e-4e38-a148-ea95c81de9e1 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1219 microversion: 2.1 time: 0.070196 Jun 15 14:59:45.512874 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 286/553] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:45 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:45.966827 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:45.967567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:45.979062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:45.979062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:45.979062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:45.979062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:46.134695 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:46.144177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7f648848-0a86-4358-b8e8-b2cc8790bcd5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.183159 Jun 15 14:59:46.145034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 268/554] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:45 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:46.214671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:46.215326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:46.222906 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:46.223357 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:46.224313 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:46.224756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:46.354898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:46.364898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:46.366490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:46.368250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3293aa01-cb2e-455a-b8ae-ca74b132ed0d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.157955 Jun 15 14:59:46.368811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 287/555] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:46 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:46.529653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-48a74115-2647-423d-83c7-db5de4fd1d7f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:46.530300 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-48a74115-2647-423d-83c7-db5de4fd1d7f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:46.584955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-48a74115-2647-423d-83c7-db5de4fd1d7f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:46.592212 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-48a74115-2647-423d-83c7-db5de4fd1d7f tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1219 microversion: 2.1 time: 0.066532 Jun 15 14:59:46.592774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 269/556] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:46 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:47.165227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:47.165846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:47.171868 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:47.172320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:47.173086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:47.173521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:47.304027 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:47.312711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e87a91e2-63b5-453a-bf4f-7a678f8b2af2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.151345 Jun 15 14:59:47.313213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 288/557] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:47 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:47.387815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:47.388424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:47.394410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:47.394865 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:47.396864 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:47.396864 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:47.529191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:47.538196 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:47.540687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:47.541841 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3a01fede-91ed-4b43-8ea2-8b48e8a2fbae tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1809 microversion: 2.20 time: 0.159158 Jun 15 14:59:47.542422 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 270/558] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:47 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:47.619058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:47.619058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:47.623705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:47.624162 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:47.624992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:47.625446 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:47.705310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:47.705310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-37e86bb2-72c8-49ad-ae62-ab9c891d3832 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1223 microversion: 2.1 time: 0.094025 Jun 15 14:59:47.705310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 289/559] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:47 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:48.330379 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:48.330995 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:48.337876 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:48.338385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:48.339339 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:48.339778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:48.474573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:48.483947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0c3e8f71-34e2-4086-b50b-7bc685526db5 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.157281 Jun 15 14:59:48.484523 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 271/560] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:48 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:48.560507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:48.561119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:48.567697 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:48.568153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:48.568917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:48.569358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:48.572875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:48.703291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:48.712750 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:48.714236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:48.715504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7e0df1d1-1299-4e43-993f-331f0a3f7607 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1796 microversion: 2.20 time: 0.159001 Jun 15 14:59:48.716275 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 290/561] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 14:59:48 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 14:59:48.720082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:48.720082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:48.723886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:48.724594 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:48.725564 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:48.726928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:48.791671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:48.799756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ce0e3fb9-f058-4028-ade5-86693c102e4b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1271 microversion: 2.1 time: 0.087193 Jun 15 14:59:48.800332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 272/562] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:48 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:49.468291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:49.469292 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:49.475992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:49.477067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:49.478084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:49.478548 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:49.501160 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:49.501975 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:49.502363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lazy-loading 'flavor' on Instance uuid e8490a7b-6956-4086-a14b-8d892496d608 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:59:49.509686 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:49.510139 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:49.510945 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:49.511385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:49.714931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:49.732242 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f0ea839b-3bf3-40c1-9ea4-243ab9c4f453 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.225382 Jun 15 14:59:49.732242 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 273/563] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:49 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:49.820473 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:49.821432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:49.827906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:49.828559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:49.829332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:49.829775 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:49.926334 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:49.935584 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f02052c7-b056-4383-83a7-9438b3d82285 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1289 microversion: 2.1 time: 0.119941 Jun 15 14:59:49.946399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 274/564] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:49 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:50.108488 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-3de62e8b-5dab-4091-9527-ce85294bd688 req-cd4dee5f-03f5-4b79-b880-d0d41cb8343a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0407de-1fe3-40c9-92ff-a14f1a81f985", "name": "network-vif-plugged", "status": "completed", "tag": "e4963401-4f83-4506-b6d9-cef4682f75eb"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:50.117314 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-3de62e8b-5dab-4091-9527-ce85294bd688 req-cd4dee5f-03f5-4b79-b880-d0d41cb8343a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:50.128678 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-3de62e8b-5dab-4091-9527-ce85294bd688 req-cd4dee5f-03f5-4b79-b880-d0d41cb8343a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:50.128678 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-3de62e8b-5dab-4091-9527-ce85294bd688 req-cd4dee5f-03f5-4b79-b880-d0d41cb8343a service nova] Creating event network-vif-plugged:e4963401-4f83-4506-b6d9-cef4682f75eb for instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 on hv-cinder-84517 Jun 15 14:59:50.133444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-3de62e8b-5dab-4091-9527-ce85294bd688 req-cd4dee5f-03f5-4b79-b880-d0d41cb8343a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028716 Jun 15 14:59:50.133989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 275/565] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:50.172495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-657ec2a5-f538-4f3f-8664-86bfa6c54e18 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/action" status: 200 len: 32 microversion: 2.1 time: 0.708025 Jun 15 14:59:50.173097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 291/566] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 14:59:49 2022] POST /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/action => generated 32 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 14:59:50.184136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:50.191778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:50.191778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:50.191778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:50.192274 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:50.192716 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:50.385055 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:50.393059 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-65688727-83c5-453d-b9f0-2f02e0aacc99 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.214548 Jun 15 14:59:50.393616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 276/567] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:50 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:50.740448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:50.741284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:50.748483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:50.748992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:50.749766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:50.750714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:50.953479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:50.954298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:50.962704 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:50.963255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:50.964092 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:50.964593 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:51.092363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:51.100056 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-cf071f5c-dcc5-4be4-b7ae-f6c6f475bdd6 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.364309 Jun 15 14:59:51.100624 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 292/568] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:50 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:51.187976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:51.196486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5a6b1938-cd0c-422f-bb1e-d954900f1b8d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.246989 Jun 15 14:59:51.197052 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 277/569] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:50 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:51.410990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:51.411703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:51.418832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:51.419285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:51.420058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:51.420502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:51.628299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:51.636432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3b917ccd-bab6-4161-aba6-eb8676b46a37 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.229266 Jun 15 14:59:51.637013 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 293/570] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:51 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:51.987349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-022b1469-737c-4581-993d-d503ed1c19f0 req-1174ac0b-8aa2-4480-91ee-db7e8042287d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6", "tag": "0731b3fa-6348-4cc8-94af-8650cd4ace46"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:51.996854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-022b1469-737c-4581-993d-d503ed1c19f0 req-1174ac0b-8aa2-4480-91ee-db7e8042287d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:51.997298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-022b1469-737c-4581-993d-d503ed1c19f0 req-1174ac0b-8aa2-4480-91ee-db7e8042287d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:52.010548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-022b1469-737c-4581-993d-d503ed1c19f0 req-1174ac0b-8aa2-4480-91ee-db7e8042287d service nova] Creating event network-changed:0731b3fa-6348-4cc8-94af-8650cd4ace46 for instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 on hv-cinder-84517 Jun 15 14:59:52.015258 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-022b1469-737c-4581-993d-d503ed1c19f0 req-1174ac0b-8aa2-4480-91ee-db7e8042287d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032381 Jun 15 14:59:52.015842 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 278/571] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:52.117755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:52.127430 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:52.127430 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:52.127430 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:52.127430 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:52.127770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:52.215186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:52.215887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:52.222622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:52.223066 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:52.223833 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:52.224264 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:52.334337 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:52.342200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0f74cb32-dff7-4dec-9ea4-3198a1007f16 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1259 microversion: 2.1 time: 0.228286 Jun 15 14:59:52.342864 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 294/572] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:52 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1259 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:52.377426 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:52.385143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6a64c63b-4090-4529-b257-3eb9eabe754b tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.175252 Jun 15 14:59:52.390034 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 279/573] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:52 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:52.653747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:52.654544 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:52.660660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:52.661209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:52.662222 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:52.662862 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:52.823739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:52.831689 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3e92dc4a-8c88-46cb-aa6b-9acf5c605af6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.182189 Jun 15 14:59:52.832254 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 295/574] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:52 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:53.355058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b9c5771d-2590-490a-a01a-a0b340517e9e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:53.355599 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b9c5771d-2590-490a-a01a-a0b340517e9e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:53.358813 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:53.359426 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:53.362107 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9c5771d-2590-490a-a01a-a0b340517e9e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.362598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9c5771d-2590-490a-a01a-a0b340517e9e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.363365 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9c5771d-2590-490a-a01a-a0b340517e9e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.363805 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9c5771d-2590-490a-a01a-a0b340517e9e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.365951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.367061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.367827 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.368264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.388032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b9c5771d-2590-490a-a01a-a0b340517e9e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0/ips" status: 200 len: 149 microversion: 2.1 time: 0.037271 Jun 15 14:59:53.388607 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 280/575] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 14:59:53 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 14:59:53.399075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aac54778-f972-4ec5-8d4b-2cc9591132f1"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:53.400219 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:53.406289 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.406747 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.407518 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.407956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.488576 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Invalid volume: volume aac54778-f972-4ec5-8d4b-2cc9591132f1 is already attached to instances: ba5993ec-f833-475c-8ea7-16536586674d Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: POST /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0/os-volume_attachments HTTP/1.1 Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 74 Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 14:59:53.490457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {"volumeAttachment": {"volumeId": "aac54778-f972-4ec5-8d4b-2cc9591132f1"}} Jun 15 14:59:53.492442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Invalid volume: volume aac54778-f972-4ec5-8d4b-2cc9591132f1 is already attached to instances: ba5993ec-f833-475c-8ea7-16536586674d Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'server_id': '4db8069f-14f9-458c-984e-4c7e3ea32df0', 'body': {'volumeAttachment': {'volumeId': 'aac54778-f972-4ec5-8d4b-2cc9591132f1'}}} Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aac54778-f972-4ec5-8d4b-2cc9591132f1 is already attached to instances: ba5993ec-f833-475c-8ea7-16536586674d Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:53.493303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aac54778-f972-4ec5-8d4b-2cc9591132f1 is already attached to instances: ba5993ec-f833-475c-8ea7-16536586674d Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 14:59:53.499776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aac54778-f972-4ec5-8d4b-2cc9591132f1 is already attached to instances: ba5993ec-f833-475c-8ea7-16536586674d Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 400 to user: Invalid volume: volume aac54778-f972-4ec5-8d4b-2cc9591132f1 is already attached to instances: ba5993ec-f833-475c-8ea7-16536586674d {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-48d14620-5b6b-4a8d-b4f6-a5504ceece1c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097382 Jun 15 14:59:53.502050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 281/576] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 14:59:53 2022] POST /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 14:59:53.503734 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:53.503734 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:53.505176 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.505629 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.506435 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.507480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.534553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:53.546458 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-32cb0d8e-1cf9-420d-a1c7-63175fe55312 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1444 microversion: 2.1 time: 0.191159 Jun 15 14:59:53.547070 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 296/577] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:53 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1444 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:53.552368 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:53.553050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:53.560412 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.560854 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.562094 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.562094 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.591960 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 14:59:53.733474 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:53.742083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ba1f2d76-fc01-4556-8839-35ef12d53400 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.247625 Jun 15 14:59:53.742803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 282/578] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:53 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:53.747550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:53.748390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:53.754589 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.755263 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.758894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:53.758894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:53.772430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:53.961079 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:53.975555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e0bd68b1-97e1-4326-96e9-1c5e69baedaa tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1444 microversion: 2.1 time: 0.231152 Jun 15 14:59:53.988209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 283/579] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:53 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1444 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:53.988209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:53.988209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:54.002445 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.002970 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.004153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.004364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.122596 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e4b8e333-5e32-4241-98d4-08419ec8dca5 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 204 len: 0 microversion: 2.1 time: 0.574050 Jun 15 14:59:54.126953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 297/580] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 14:59:53 2022] DELETE /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 14:59:54.134320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:54.135027 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:54.141226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.141670 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.142619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.143071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.535922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:54.540298 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:54.545832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9c8b4200-ef19-40ee-a107-54c46b41550d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.567183 Jun 15 14:59:54.546917 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 284/581] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:53 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:54.548297 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-740178f1-52a4-40dc-a93a-9cf6abc15a04 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1680 microversion: 2.1 time: 0.419605 Jun 15 14:59:54.549142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 298/582] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:54 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1680 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:54.760133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:54.760663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:54.766769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.767211 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.767973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:54.768411 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:54.896698 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:54.904998 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bb15b1cd-d9d5-4490-a764-b8eebed4e2fc tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.149425 Jun 15 14:59:54.905784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 285/583] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:54 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:55.606274 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:55.606274 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:55.607443 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:55.607443 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:55.608601 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:55.608800 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:55.609117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.609117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:55.609117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.609656 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.609972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:55.610355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:55.610355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.610355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:55.772691 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:55.775312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:55.781418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-48a48537-b9db-426a-b4ba-005a880e3b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.221352 Jun 15 14:59:55.782313 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 299/584] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:55 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:55.782786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-59d08ecc-89cf-45ff-b82b-71c92f49a5d6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1680 microversion: 2.1 time: 0.220842 Jun 15 14:59:55.783415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 286/585] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:55 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:55.924314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:55.924946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:55.935289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.936036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:55.936884 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:55.937260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:56.189436 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:56.197765 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e62ca595-2d2d-46d8-bb2f-11d1372726b8 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.278822 Jun 15 14:59:56.198358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 300/586] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:55 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:56.643039 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-77c5b81f-dd58-4cee-a251-997e24b747cb req-7ae8212a-fc02-4155-b9e2-d096852560c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0407de-1fe3-40c9-92ff-a14f1a81f985", "tag": "e4963401-4f83-4506-b6d9-cef4682f75eb"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:56.649457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=8 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:56.655041 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-77c5b81f-dd58-4cee-a251-997e24b747cb req-7ae8212a-fc02-4155-b9e2-d096852560c3 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:56.655484 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-77c5b81f-dd58-4cee-a251-997e24b747cb req-7ae8212a-fc02-4155-b9e2-d096852560c3 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:56.669187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-77c5b81f-dd58-4cee-a251-997e24b747cb req-7ae8212a-fc02-4155-b9e2-d096852560c3 service nova] Creating event network-changed:e4963401-4f83-4506-b6d9-cef4682f75eb for instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 on hv-cinder-84517 Jun 15 14:59:56.674591 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-77c5b81f-dd58-4cee-a251-997e24b747cb req-7ae8212a-fc02-4155-b9e2-d096852560c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043208 Jun 15 14:59:56.675347 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 287/587] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:56.800622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:56.801653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:56.801806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:56.801925 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:56.809372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:56.809825 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:56.809994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:56.810588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:56.810765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:56.811187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:56.811712 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:56.812160 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:57.040363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:57.049651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-54a3feb9-1dc9-4269-940e-9d374f9a2c33 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1680 microversion: 2.1 time: 0.253327 Jun 15 14:59:57.061519 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 301/588] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:56 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:57.075002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:57.088146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-674b74e6-f752-4301-af50-aa8c7c7d6e6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.291539 Jun 15 14:59:57.093215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 288/589] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:56 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:57.219292 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:57.219913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:57.229593 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:57.230053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:57.230885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:57.231324 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:57.420093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:57.439115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7063cddb-13f7-4b21-a102-7f611976b74d tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.227081 Jun 15 14:59:57.439725 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 302/590] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:57 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:58.069344 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:58.070900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:58.090865 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.091347 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.092141 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.092612 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.110585 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:58.111202 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:58.125228 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.125692 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.126521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.126965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.129846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 14:59:58.211204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:58.218986 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-300a511f-deb7-43cb-8f83-7fdf72170545 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1613 microversion: 2.1 time: 0.154022 Jun 15 14:59:58.225628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 289/591] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:58 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:58.305433 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:58.314310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-871c494a-e8ec-4c7b-944f-23272b07814e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.207402 Jun 15 14:59:58.324500 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 303/592] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:58 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:58.456872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:58.457480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:58.465303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.465751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.466554 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.466989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.636570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:58.644681 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-925d5f64-436e-45a9-b3ac-2ab8e2c31f58 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.191909 Jun 15 14:59:58.645413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 290/593] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:58 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:58.693398 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-b9f98dea-0704-4938-b371-eb40fec96687 req-a144baa7-7cc0-42d3-b7c9-9ad06bcb95ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db8069f-14f9-458c-984e-4c7e3ea32df0", "name": "network-vif-deleted", "tag": "4e147639-36c4-40e4-b4e9-40be7f9e982c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 14:59:58.703839 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-b9f98dea-0704-4938-b371-eb40fec96687 req-a144baa7-7cc0-42d3-b7c9-9ad06bcb95ef service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:58.704367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-b9f98dea-0704-4938-b371-eb40fec96687 req-a144baa7-7cc0-42d3-b7c9-9ad06bcb95ef service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:58.716202 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-b9f98dea-0704-4938-b371-eb40fec96687 req-a144baa7-7cc0-42d3-b7c9-9ad06bcb95ef service nova] Creating event network-vif-deleted:4e147639-36c4-40e4-b4e9-40be7f9e982c for instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 on hv-cinder-84517 Jun 15 14:59:58.721789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-b9f98dea-0704-4938-b371-eb40fec96687 req-a144baa7-7cc0-42d3-b7c9-9ad06bcb95ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 Jun 15 14:59:58.722409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 304/594] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 14:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 14:59:59.237084 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:59.240736 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:59.249410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:59.250210 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:59.251290 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:59.251811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:59.305046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:59.305619 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:59.306395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'fault' on Instance uuid 4db8069f-14f9-458c-984e-4c7e3ea32df0 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 14:59:59.333671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:59.336195 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:59.343881 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:59.344629 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:59.345723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:59.346523 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:59.399252 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:59.420627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ca794028-07d2-438c-8f3b-8ca4b3822275 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1331 microversion: 2.1 time: 0.187509 Jun 15 14:59:59.421959 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 291/595] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:59 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1331 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 14:59:59.503506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:59.511723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f0b64dc5-1af5-4c51-8ee5-03e33d8c7a0c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.183208 Jun 15 14:59:59.512509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 305/596] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:59 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 14:59:59.662972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 14:59:59.664936 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 14:59:59.669651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:59.670112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:59.670922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 14:59:59.671359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 14:59:59.804691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 14:59:59.812260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7910f91c-1c6e-4dd3-888d-561fedf3dfff tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.153162 Jun 15 14:59:59.812826 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 292/597] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 14:59:59 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:00.439899 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:00.440671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:00.448847 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.449301 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.450076 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.450641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.467053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:00.467576 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:00.474011 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.474493 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.475896 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.476315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.483083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.483628 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.484056 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'fault' on Instance uuid 4db8069f-14f9-458c-984e-4c7e3ea32df0 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:00.529097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:00.536806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c02948bb-694a-45ec-9c27-b5185c06a879 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 200 len: 1331 microversion: 2.1 time: 0.101016 Jun 15 15:00:00.537639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 306/598] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:00 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:00.541750 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:00.542419 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:00.552639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.552639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.552639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.553037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.609186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lazy-loading 'services' on Instance uuid 97c39abd-c1c7-443f-802e-a65f0e0888ec {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:00.689843 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:00.698282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9dccb574-8d1f-4672-b8e4-31d23d57bbd1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.159930 Jun 15 15:00:00.699099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 307/599] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:00 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:00.830071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:00.830708 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:00.837357 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.837807 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.838597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:00.839037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:00.968823 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:00.977540 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c1546c32-d549-4d96-a46a-9270a12e4beb tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.151220 Jun 15 15:00:00.978115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 308/600] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:00 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:01.115255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9cf9de8f-5cc2-4234-bea3-9f34d39087f7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-volume_attachments/1adb842f-fec2-4c67-88ee-8a176e7d184e" status: 202 len: 0 microversion: 2.1 time: 0.651856 Jun 15 15:00:01.115967 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 293/601] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:00:00 2022] DELETE /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-volume_attachments/1adb842f-fec2-4c67-88ee-8a176e7d184e => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:00:01.554397 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:01.555078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:01.561666 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:01.562164 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:01.563088 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:01.563525 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:01.577250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 HTTP/1.1 Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:00:01.579583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:00:01.580909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '4db8069f-14f9-458c-984e-4c7e3ea32df0'} Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:01.581638 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:00:01.582875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:01.584712 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:01.584712 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-cfce09ff-7018-4ad2-bf6e-887929574eba tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 404 len: 111 microversion: 2.1 time: 0.030710 Jun 15 15:00:01.584712 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 309/602] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:01 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:01.591923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7f0c12c8-463e-484c-b73f-ca130cb8a56f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '.version_select at 0x7f693aba49d0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:01.717125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:01.718008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:01.724580 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:01.725743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:01.727189 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:01.727678 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:01.745554 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7f0c12c8-463e-484c-b73f-ca130cb8a56f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485096880" status: 202 len: 0 microversion: 2.1 time: 0.158150 Jun 15 15:00:01.747798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 294/603] 10.222.0.23 () {58 vars in 1217 bytes} [Wed Jun 15 15:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485096880 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:01.927549 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:01.935953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f7d0a6cf-76ea-4c5a-a7e5-3a5143aef0ec tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.222987 Jun 15 15:00:01.936525 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 310/604] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:01 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:01.993528 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:01.994192 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:02.000403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.000852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.001614 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.002051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.164769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:02.176661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a859abab-c209-4a49-8a0d-20bef68764a4 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.186053 Jun 15 15:00:02.178088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 295/605] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:01 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:02.450019 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-42917bce-9da4-49e1-919f-1571a8e47b03 req-7a0cc024-c2c3-4ea2-baed-ab719c95ac83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6", "name": "network-vif-plugged", "status": "completed", "tag": "0731b3fa-6348-4cc8-94af-8650cd4ace46"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:02.459231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-42917bce-9da4-49e1-919f-1571a8e47b03 req-7a0cc024-c2c3-4ea2-baed-ab719c95ac83 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.461309 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-42917bce-9da4-49e1-919f-1571a8e47b03 req-7a0cc024-c2c3-4ea2-baed-ab719c95ac83 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.471334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-42917bce-9da4-49e1-919f-1571a8e47b03 req-7a0cc024-c2c3-4ea2-baed-ab719c95ac83 service nova] Creating event network-vif-plugged:0731b3fa-6348-4cc8-94af-8650cd4ace46 for instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 on hv-cinder-84517 Jun 15 15:00:02.476355 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-42917bce-9da4-49e1-919f-1571a8e47b03 req-7a0cc024-c2c3-4ea2-baed-ab719c95ac83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030038 Jun 15 15:00:02.477197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 311/606] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:02.778870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:02.782364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:02.785849 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.786267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.787404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.787531 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.868172 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'services' on Instance uuid ba5993ec-f833-475c-8ea7-16536586674d {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:02.954915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:02.955616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:02.962651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.963105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:02.963869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:02.964310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.104387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:03.112345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-389883fd-8bcd-427f-9af3-c6716a81f84c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.162179 Jun 15 15:00:03.112908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 312/607] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:02 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:03.194986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:03.195663 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:03.201891 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.202438 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.203238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.203674 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.281182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b9b60b04-33f7-413a-9580-2c6077d6336d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments/aac54778-f972-4ec5-8d4b-2cc9591132f1" status: 202 len: 0 microversion: 2.1 time: 0.505979 Jun 15 15:00:03.281771 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 296/608] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:00:02 2022] DELETE /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments/aac54778-f972-4ec5-8d4b-2cc9591132f1 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:03.290221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3b726e66-9318-44e1-8ee1-16d67c8d7a5d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:03.291283 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3b726e66-9318-44e1-8ee1-16d67c8d7a5d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:03.304430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b726e66-9318-44e1-8ee1-16d67c8d7a5d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.304430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b726e66-9318-44e1-8ee1-16d67c8d7a5d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.304430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b726e66-9318-44e1-8ee1-16d67c8d7a5d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.304430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b726e66-9318-44e1-8ee1-16d67c8d7a5d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.334619 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3b726e66-9318-44e1-8ee1-16d67c8d7a5d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048492 Jun 15 15:00:03.335180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 297/609] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:03 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:03.340590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-eb816024-9b09-483a-b5b0-374a713f8592 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:03.344667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:03.349897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb816024-9b09-483a-b5b0-374a713f8592 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.349897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb816024-9b09-483a-b5b0-374a713f8592 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.353600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b9cdbc8a-fa7e-499c-a695-832aa2a70020 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.163130 Jun 15 15:00:03.354156 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 313/610] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:03 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:03.371273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-eb816024-9b09-483a-b5b0-374a713f8592 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Going to try to stop instance {{(pid=124695) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 15:00:03.815405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-eb816024-9b09-483a-b5b0-374a713f8592 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action" status: 202 len: 0 microversion: 2.1 time: 0.478192 Jun 15 15:00:03.816038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 298/611] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:00:03 2022] POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:03.825599 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:03.826237 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:03.832445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.832939 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.833731 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:03.834192 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:03.962315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:03.970067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3eab2d8c-c9ea-440a-9158-e4e3c27fdb31 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.147961 Jun 15 15:00:03.970429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 314/612] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:03 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:04.131637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:04.132339 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:04.138767 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.139217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.139981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.140466 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.143183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:04.277840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:04.285691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4eae8d8b-fd22-43ec-a442-c1a6cfac21a5 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.159393 Jun 15 15:00:04.286269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 299/613] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:04 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:04.345696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d33d1e5a-f64c-4e2a-bc24-9e2ea2229e62 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:04.346859 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d33d1e5a-f64c-4e2a-bc24-9e2ea2229e62 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:04.353301 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d33d1e5a-f64c-4e2a-bc24-9e2ea2229e62 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.353758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d33d1e5a-f64c-4e2a-bc24-9e2ea2229e62 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.354570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d33d1e5a-f64c-4e2a-bc24-9e2ea2229e62 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.355015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d33d1e5a-f64c-4e2a-bc24-9e2ea2229e62 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.370597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:04.371241 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:04.377430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.382729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.382729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.382729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.385583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d33d1e5a-f64c-4e2a-bc24-9e2ea2229e62 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Jun 15 15:00:04.386152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 315/614] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:04 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:04.512381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:04.519991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1b9fade8-7dcb-4743-82ea-8cd117a7bf47 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1319 microversion: 2.1 time: 0.153167 Jun 15 15:00:04.520908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 300/615] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:04 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:04.987681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:04.988931 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:04.996060 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.996505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:04.997374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:04.997809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.142600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:05.151309 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9b6bac42-ac07-409a-951a-421a0c5ef893 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.167518 Jun 15 15:00:05.151858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 316/616] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:04 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:05.302464 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:05.303090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:05.309483 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.309934 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.310726 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.311165 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.397057 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8f42c34e-d240-4b32-962a-26972ff872b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:05.398106 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8f42c34e-d240-4b32-962a-26972ff872b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:05.404351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f42c34e-d240-4b32-962a-26972ff872b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.404887 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f42c34e-d240-4b32-962a-26972ff872b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.405736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f42c34e-d240-4b32-962a-26972ff872b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.406272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f42c34e-d240-4b32-962a-26972ff872b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.436226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8f42c34e-d240-4b32-962a-26972ff872b7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Jun 15 15:00:05.436795 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 317/617] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:05 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:05.441625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:05.450435 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c629575c-fb74-4aaf-899d-80d00d18012e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.152092 Jun 15 15:00:05.451476 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 301/618] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:05 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:05.536676 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:05.537318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:05.539272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:05.544139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.544586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.545345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.545777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.673510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:05.682154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d0bafff6-0166-4596-8e70-3bc95be4c24c tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1509 microversion: 2.1 time: 0.149291 Jun 15 15:00:05.682754 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 318/619] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:05 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:05.698525 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-473b1717-9c5f-4fb0-91c6-1ed95a9a9752 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "299b4f2f-1596-479b-b38a-f6ec15b463c7", "device": "/dev/sdb"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:05.699661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-473b1717-9c5f-4fb0-91c6-1ed95a9a9752 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:05.705779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473b1717-9c5f-4fb0-91c6-1ed95a9a9752 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.706255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473b1717-9c5f-4fb0-91c6-1ed95a9a9752 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:05.707095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473b1717-9c5f-4fb0-91c6-1ed95a9a9752 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:05.707530 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473b1717-9c5f-4fb0-91c6-1ed95a9a9752 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.168542 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:06.169159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:06.175667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:06.176153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.176924 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:06.177375 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.306231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:06.313975 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-becccc98-ff09-4911-9575-37b13afc039c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.149266 Jun 15 15:00:06.314573 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 319/620] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:06 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:06.447757 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ae600043-b493-4bde-8645-1154b18174a3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:06.448669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ae600043-b493-4bde-8645-1154b18174a3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:06.454627 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae600043-b493-4bde-8645-1154b18174a3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:06.455075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae600043-b493-4bde-8645-1154b18174a3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.455950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae600043-b493-4bde-8645-1154b18174a3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:06.456378 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ae600043-b493-4bde-8645-1154b18174a3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.488422 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ae600043-b493-4bde-8645-1154b18174a3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Jun 15 15:00:06.489282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 320/621] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:06 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:06.495530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:06.496132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:06.502061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:06.502667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.503469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:06.503921 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:06.520753 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:06.638449 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:06.647783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1ce77bce-594d-4ccb-8b75-5f2c4aad2603 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.156977 Jun 15 15:00:06.648343 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 321/622] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:06 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:07.331093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:07.331723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:07.338437 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.338888 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.339652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.340134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.428461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-473b1717-9c5f-4fb0-91c6-1ed95a9a9752 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "POST /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.733251 Jun 15 15:00:07.429189 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 302/623] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 15:00:05 2022] POST /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6/os-volume_attachments => generated 194 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:07.471216 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:07.481554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-32dc6cc9-bb52-4739-8809-d8ff739e8ba8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.153139 Jun 15 15:00:07.481554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 322/624] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:07 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:07.500578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-25d65bd0-310e-4f7a-a73b-740d4fc69483 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:07.501647 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-25d65bd0-310e-4f7a-a73b-740d4fc69483 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:07.507924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25d65bd0-310e-4f7a-a73b-740d4fc69483 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.508370 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25d65bd0-310e-4f7a-a73b-740d4fc69483 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.509130 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25d65bd0-310e-4f7a-a73b-740d4fc69483 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.509563 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25d65bd0-310e-4f7a-a73b-740d4fc69483 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.545793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-25d65bd0-310e-4f7a-a73b-740d4fc69483 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049584 Jun 15 15:00:07.546875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 303/625] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:00:07 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 15:00:07.606819 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:07.607320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:07.613691 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.614144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.614950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.615393 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.640761 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:00:07.665520 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:07.666287 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:07.672573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.673031 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.673803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:07.674269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:07.808307 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:07.816236 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-aab8bc5a-c7cc-42e0-8e3b-472aeca1de25 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.155217 Jun 15 15:00:07.816798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 304/626] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:07 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:08.108815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0d359037-e939-417a-b1a4-f1518255fdf9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 204 len: 0 microversion: 2.1 time: 0.505582 Jun 15 15:00:08.109545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 323/627] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:00:07 2022] DELETE /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:00:08.117749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:08.118391 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:08.120462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:08.125197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.130276 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.130276 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.130276 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.255850 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:08.263302 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9a06fbc6-b86d-4a28-854e-bf408e871a96 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1678 microversion: 2.1 time: 0.149441 Jun 15 15:00:08.263880 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 305/628] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:08 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:08.497653 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:08.498528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:08.506569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.506569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.507036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.507480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.639783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:08.648036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2e639348-152e-4000-ad14-048056e26087 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.154579 Jun 15 15:00:08.648603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 324/629] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:08 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:08.833536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:08.834206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:08.841267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.841715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.842499 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:08.842933 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:08.972361 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:08.981804 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8b4c3652-b7c0-4562-a19f-ebbc3b856ae7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.152775 Jun 15 15:00:08.982396 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 306/630] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:08 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:09.280103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:09.280820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:09.287566 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:09.288021 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:09.288794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:09.289234 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:09.424486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:09.432618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fffb6eaa-1e36-4ea3-aeec-2164b6055ced tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1678 microversion: 2.1 time: 0.156456 Jun 15 15:00:09.433188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 325/631] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:09 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:09.665794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:09.666381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:09.672448 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:09.672957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:09.673713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:09.674147 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:09.805910 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:09.815260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c8ae1da9-f08d-49a4-823c-f7859a5fe2f0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.154252 Jun 15 15:00:09.815811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 307/632] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:09 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:09.998582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:09.999194 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:10.006681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.007134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.007901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.008341 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.141342 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:10.151825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fb6514ee-7132-4eaa-9d29-b3cd9a65c31d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.156650 Jun 15 15:00:10.152869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 326/633] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:09 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:10.449687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:10.462705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:10.462705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.462705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.462705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.463110 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.596063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:10.600481 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-eca9bafa-f6a6-41de-8252-767ac4a7e046 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1678 microversion: 2.1 time: 0.154598 Jun 15 15:00:10.601040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 308/634] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:10 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:10.837273 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:10.837795 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:10.843897 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.844346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.845121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:10.845545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:10.972187 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:10.980420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-317ce48d-9788-484d-8b2f-3612c1a37f1d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.147537 Jun 15 15:00:10.980986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 327/635] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:10 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:11.172188 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:11.172797 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:11.179247 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:11.179739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:11.180544 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:11.181085 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:11.310877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:11.319815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1d3f1dbb-de01-4ffb-abbe-c0392e558b45 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.151501 Jun 15 15:00:11.320386 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 309/636] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:11 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:11.618706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:11.619319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:11.625831 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:11.626328 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:11.627092 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:11.627529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:11.764452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:11.772175 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0753991c-8576-4dcd-b502-0d3f3a3a3b64 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1678 microversion: 2.1 time: 0.158003 Jun 15 15:00:11.772738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 328/637] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:11 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:11.997800 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:11.998444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:12.005499 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.005956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.006740 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.007180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.131517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:12.139133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2fa46112-ba93-41e6-a3c4-c36b0a8ab416 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.145192 Jun 15 15:00:12.139762 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 310/638] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:11 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:12.337587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:12.338120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:12.344168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.344618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.345382 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.345821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.474982 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:12.483225 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2a3dee27-d844-4b54-bac4-d96e6ab6d121 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.149778 Jun 15 15:00:12.483989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 329/639] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:12 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:12.789490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:12.790107 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:12.796212 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.796671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.797438 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:12.797873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:12.938470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:12.947231 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-726d3cd2-b17c-4f75-961d-e255f57d8958 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1678 microversion: 2.1 time: 0.161628 Jun 15 15:00:12.947778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 311/640] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:12 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:13.156755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:13.157281 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:13.168388 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.168839 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.169622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.170061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.314138 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:13.318808 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d56ee08b-8dd9-4088-a84d-da6c9b4798af tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.166070 Jun 15 15:00:13.319369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 330/641] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:13 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:13.500789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:13.501394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:13.508170 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.508618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.509378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.509815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.647807 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:13.662773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-14e82a5c-82dd-485e-8adb-8609a082c411 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1737 microversion: 2.1 time: 0.158865 Jun 15 15:00:13.662773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 312/642] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:13 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:13.965751 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:13.966553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:13.972847 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.973932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:13.974253 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:13.974690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.104685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:14.112111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-26961603-2031-418c-8ce9-ffa3321dc9ee tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1678 microversion: 2.1 time: 0.150223 Jun 15 15:00:14.112664 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 331/643] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:13 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:14.336298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:14.336896 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:14.342800 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.343247 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.344007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.344439 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.480870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:14.490588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f259acec-a1fe-41f3-881e-3dc0cb7447cb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.158271 Jun 15 15:00:14.491104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 313/644] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:14 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:14.500239 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-f4df4243-b8ad-4af9-9cb3-4aacab31942b req-2f959d09-ffb9-4dd1-a5d6-28d205185196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5993ec-f833-475c-8ea7-16536586674d", "name": "network-vif-deleted", "tag": "3ee7db41-7d40-4611-bbca-5160488232ba"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:14.509044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f4df4243-b8ad-4af9-9cb3-4aacab31942b req-2f959d09-ffb9-4dd1-a5d6-28d205185196 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.509491 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f4df4243-b8ad-4af9-9cb3-4aacab31942b req-2f959d09-ffb9-4dd1-a5d6-28d205185196 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.521714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-f4df4243-b8ad-4af9-9cb3-4aacab31942b req-2f959d09-ffb9-4dd1-a5d6-28d205185196 service nova] Creating event network-vif-deleted:3ee7db41-7d40-4611-bbca-5160488232ba for instance ba5993ec-f833-475c-8ea7-16536586674d on hv-cinder-84517 Jun 15 15:00:14.527059 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-f4df4243-b8ad-4af9-9cb3-4aacab31942b req-2f959d09-ffb9-4dd1-a5d6-28d205185196 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 Jun 15 15:00:14.527867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 332/645] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:14.673535 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:14.674324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:14.681565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.682355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.683144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.683588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.700604 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:14.823592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:14.831816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-09fc3e98-08b9-402e-8775-5288b385fc56 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1717 microversion: 2.1 time: 0.162148 Jun 15 15:00:14.833108 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 314/646] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:14 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:14.940525 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:14.941116 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:14.948376 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.948834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:14.949606 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:14.950048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.032020 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] HTTP exception thrown: Cannot 'detach_volume' instance e8490a7b-6956-4086-a14b-8d892496d608 while it is in vm_state rescued Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Request method failure captured: Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments/b34a2b06-f3a4-43f0-b9be-29d43959e90c HTTP/1.1 Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL7VT0clRDZfL7x3_66jziJtK6z-0PVYCUkCP9eyGovsLr76J9px7zhftxgQBzjQ7S6QIC9D-zHaWdZ3t8aaxLb2qB8iCiCoSY7DAhftK1wKERI1XOpQ-PCuTdsQQzVyAMXaDHzg-8mIud9GRU3ikcX7K7Q77bzyUBLb8m2-5AoCi4 Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:00:15.033626 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: cbc9d5ce4a3241ea898f216543114fdf Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:00:15.034952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Cannot 'detach_volume' instance e8490a7b-6956-4086-a14b-8d892496d608 while it is in vm_state rescued Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'server_id': 'e8490a7b-6956-4086-a14b-8d892496d608', 'id': 'b34a2b06-f3a4-43f0-b9be-29d43959e90c'} Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8490a7b-6956-4086-a14b-8d892496d608 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:15.035834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e8490a7b-6956-4086-a14b-8d892496d608 while it is in vm_state rescued Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e8490a7b-6956-4086-a14b-8d892496d608 while it is in vm_state rescued Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:15.037188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Returning 409 to user: Cannot 'detach_volume' instance e8490a7b-6956-4086-a14b-8d892496d608 while it is in vm_state rescued {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:15.038251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-45f24c57-664a-4b36-b777-5d903c5c704a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments/b34a2b06-f3a4-43f0-b9be-29d43959e90c" status: 409 len: 152 microversion: 2.1 time: 0.098888 Jun 15 15:00:15.038251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 333/647] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:00:14 2022] DELETE /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments/b34a2b06-f3a4-43f0-b9be-29d43959e90c => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 15:00:15.044745 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6aa4977e-eac2-4b63-a3c3-00b80fa0ed5b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:15.045281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6aa4977e-eac2-4b63-a3c3-00b80fa0ed5b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:15.052511 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6aa4977e-eac2-4b63-a3c3-00b80fa0ed5b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.052962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6aa4977e-eac2-4b63-a3c3-00b80fa0ed5b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.053786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6aa4977e-eac2-4b63-a3c3-00b80fa0ed5b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.054248 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6aa4977e-eac2-4b63-a3c3-00b80fa0ed5b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.130042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:15.131004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:15.139531 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.140207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.140988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.141420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.217002 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:15.225296 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-95af692a-4fa3-4f2c-8a57-87052df83c2b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1324 microversion: 2.1 time: 0.100235 Jun 15 15:00:15.226564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 334/648] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:15 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1324 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:15.299884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6aa4977e-eac2-4b63-a3c3-00b80fa0ed5b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "POST /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/action" status: 202 len: 0 microversion: 2.1 time: 0.254359 Jun 15 15:00:15.299884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 315/649] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:00:15 2022] POST /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:15.304997 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:15.305643 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:15.312061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.312514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.313322 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.313760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.461160 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:15.469615 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f86856ce-ea64-4861-bb98-a4341d6525f9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.169276 Jun 15 15:00:15.470207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 335/650] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:15 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:15.509927 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:15.510663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:15.517559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.518020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.519002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:15.519680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:15.682668 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:15.690824 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9d8b3954-4536-4f28-9280-e710c874b216 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.186544 Jun 15 15:00:15.691910 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 316/651] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:15 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:16.242882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:16.243578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:16.249815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.250297 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.251258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.251696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.287570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.288022 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.288482 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'fault' on Instance uuid ba5993ec-f833-475c-8ea7-16536586674d {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:16.331719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:16.334585 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:16.352623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0f492656-94d5-477c-b339-31ecb6871c7b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 200 len: 1329 microversion: 2.1 time: 0.102325 Jun 15 15:00:16.352623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 336/652] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:16 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 1329 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:16.487849 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:16.488645 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:16.494764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.495232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.495993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.496878 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.629375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:16.637944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1612d17a-538c-4b86-aa22-0710342554ce tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.153994 Jun 15 15:00:16.638551 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 317/653] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:16 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:16.709920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:16.710480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:16.716754 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.717200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.717963 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:16.718431 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:16.849613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:16.857417 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-17616a8e-4fd9-47ed-b541-ba587e030352 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.152429 Jun 15 15:00:16.857976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 337/654] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:16 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:17.363675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:17.364326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:17.370890 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:17.371338 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:17.372099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:17.372534 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:17.386597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d HTTP/1.1 Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:00:17.388198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:00:17.389680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'ba5993ec-f833-475c-8ea7-16536586674d'} Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:17.390533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:00:17.391654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:17.392684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:17.392684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b217fd14-43e0-416c-8e6b-e58d8817b87d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 404 len: 111 microversion: 2.1 time: 0.030337 Jun 15 15:00:17.392684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 318/655] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:17 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:17.398754 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-aaf3042a-2974-4cf3-9713-bb7006433d92 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '.version_select at 0x7f693a254ca0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:17.497615 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-aaf3042a-2974-4cf3-9713-bb7006433d92 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12088609" status: 202 len: 0 microversion: 2.1 time: 0.103109 Jun 15 15:00:17.498194 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 338/656] 10.222.0.23 () {58 vars in 1214 bytes} [Wed Jun 15 15:00:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12088609 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:17.656250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:17.656788 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:17.662873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:17.663324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:17.664105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:17.664526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:17.809379 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:17.819278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f4c13704-5d8e-428e-8835-acc4258131d4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.166946 Jun 15 15:00:17.819990 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 319/657] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:17 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:17.874613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:17.875245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:17.881520 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:17.881973 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:17.882766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:17.883233 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:18.013610 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:18.022042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-cfec35c7-e9c6-406f-a2e7-2ead3083603e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.151266 Jun 15 15:00:18.022651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 339/658] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:17 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:18.340340 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c28e7acd-c47d-4f03-aac9-8aa7a7cab53e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: .version_select at 0x7f693ab46160>, body: {"keypair": {"name": "tempest-keypair-2034900751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT4GVL7is/NOVF8YItJ2LyuQgrfkTWJ41n3+TZDq/1MM2jT83GcvAoDiVNhBxR9KZTHS8e3utuhIK8L8xlWW8s8Ha7kNA8AY1tqmSBYuuqhp8/bl/79Dmr0sJcpIILO8g=="}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:18.354632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-c28e7acd-c47d-4f03-aac9-8aa7a7cab53e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:00:18.358422 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-c28e7acd-c47d-4f03-aac9-8aa7a7cab53e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:00:18.446605 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c28e7acd-c47d-4f03-aac9-8aa7a7cab53e tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110156 Jun 15 15:00:18.447475 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 320/659] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 15:00:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:18.836832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:18.837492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:18.843527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:18.843979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:18.844747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:18.845186 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:18.978341 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:18.986523 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ad9e460d-f02b-41e2-8ec1-4094c93d3d9e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.154703 Jun 15 15:00:18.987094 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 340/660] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:18 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:19.039616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:19.040168 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:19.046515 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:19.046994 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:19.047824 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:19.048257 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:19.177877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:19.185443 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-fe03f359-feb1-42af-ae30-07aafab5ed23 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.150396 Jun 15 15:00:19.186003 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 321/661] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:19 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:20.004187 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:20.004808 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:20.011328 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.011784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.012565 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.013007 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.150440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:20.158690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e0aa2372-64f6-4dbf-a9a4-e3d3229e7484 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.158846 Jun 15 15:00:20.159251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 341/662] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:19 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:20.205038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:20.209478 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:20.213116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.213572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.214429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:20.214875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:20.358628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:20.358628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dcd982fe-5f66-40aa-869d-7d3f2aac4412 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.152361 Jun 15 15:00:20.358628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 322/663] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:20 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:21.176463 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:21.177198 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:21.184045 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.184502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.185286 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.185727 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.219550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-115410391", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f4844db-ed6c-4bba-97af-aa7e459b2e26"}], "security_groups": [{"name": "tempest-securitygroup--1453344098"}], "key_name": "tempest-keypair-2034900751", "user_data": "}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:21.367095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:21.369590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] validate_networks() for [('6f4844db-ed6c-4bba-97af-aa7e459b2e26', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:00:21.375781 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-984d3aae-5b2c-41c1-aaea-cf11cb821de4 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.203569 Jun 15 15:00:21.376289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 342/664] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:21 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:21.381222 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:21.381821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:21.387788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.388236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.388998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:21.389433 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:21.605334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:21.614590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f173cafa-21f2-41c4-b664-578c0375b94b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.237263 Jun 15 15:00:21.615491 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 343/665] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:21 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:22.049037 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:00:22.049492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:00:22.049968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:00:22.050692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:00:22.051196 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:00:22.060028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.060473 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.061295 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.061732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.077997 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:00:22.082715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:00:22.093508 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:00:22.095802 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:00:22.241657 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9dbfcafd-0fed-4df4-8fbf-8d02d547a0ef tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.026125 Jun 15 15:00:22.242373 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 323/666] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:00:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:00:22.256658 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eda0cf55-b68d-4b8f-a862-4f1924ebd6a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:22.257268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-eda0cf55-b68d-4b8f-a862-4f1924ebd6a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:22.312018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-eda0cf55-b68d-4b8f-a862-4f1924ebd6a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:22.319365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-eda0cf55-b68d-4b8f-a862-4f1924ebd6a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1241 microversion: 2.1 time: 0.067241 Jun 15 15:00:22.319932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 344/667] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:22 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:22.392837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:22.393544 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:22.401051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.401499 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.402287 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.402727 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.535832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:22.546497 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6276f8f1-e983-405e-b4f6-f0afe6081e9d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.157450 Jun 15 15:00:22.547221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 324/668] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:22 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:22.632925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:22.633527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:22.639517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.639962 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.640721 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:22.641157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:22.774488 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:22.786236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-86fa629d-3343-4b9c-ade9-4c74936f7a63 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1677 microversion: 2.1 time: 0.154181 Jun 15 15:00:22.786236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 345/669] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:22 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:23.336448 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:23.337063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:23.343684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.344134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.344890 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.345326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.408268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:23.415889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-75377a63-2ede-474d-8bd4-b765dbecfc3b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1245 microversion: 2.1 time: 0.083364 Jun 15 15:00:23.416450 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 325/670] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:23 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:23.564635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:23.565244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:23.572801 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.573250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.574009 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.574486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.701909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:23.710684 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2b42051b-498f-44a9-b3f9-68ef4fb7f7bd tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.149998 Jun 15 15:00:23.711283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 346/671] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:23 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:23.800393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:23.801036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:23.807082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.807533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.808297 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.808733 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.934765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:23.942726 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ab524fb1-aea8-4783-a38e-e62cb6e43681 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1654 microversion: 2.1 time: 0.146273 Jun 15 15:00:23.943293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 326/672] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:23 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:23.959290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7bfd0eb3-a8a3-4c9f-a7ae-deaa704c5bac tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:23.965296 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7bfd0eb3-a8a3-4c9f-a7ae-deaa704c5bac tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:23.965749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7bfd0eb3-a8a3-4c9f-a7ae-deaa704c5bac tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:23.987851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7bfd0eb3-a8a3-4c9f-a7ae-deaa704c5bac tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Going to try to start instance {{(pid=124694) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 15:00:24.276016 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7bfd0eb3-a8a3-4c9f-a7ae-deaa704c5bac tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action" status: 202 len: 0 microversion: 2.1 time: 0.320953 Jun 15 15:00:24.276639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 347/673] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:00:23 2022] POST /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:24.284703 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:24.285251 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:24.291547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.292000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.292774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.293217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.423501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:24.431627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9c2a00e5-3189-410f-9f07-37b20162de36 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1663 microversion: 2.1 time: 0.150816 Jun 15 15:00:24.432193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 327/674] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:24 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:24.433168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:24.433893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:24.440083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.440849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.441633 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.442102 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.501947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:24.509347 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b31c972d-2d28-4e5b-b44d-797a54564288 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1245 microversion: 2.1 time: 0.080359 Jun 15 15:00:24.509914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 348/675] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:24 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:24.728757 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:24.729361 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:24.735393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.735844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.736610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:24.737043 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:24.863071 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:24.871102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9041c009-6944-44a5-8f9b-655069d76a8c tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.146496 Jun 15 15:00:24.871672 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 328/676] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:24 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:25.449014 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:25.452137 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:25.456822 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.457265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.458017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.458487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.526324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:25.527124 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:25.534116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.535217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.535998 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.536437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.603369 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:25.611163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-58f3c1b1-9508-4b53-8c9b-47ce0bae6c70 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1245 microversion: 2.1 time: 0.088691 Jun 15 15:00:25.611833 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 329/677] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:25 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:25.622063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:25.629789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-88cb30a8-6a00-4961-8b12-60a24f790bbc tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1663 microversion: 2.1 time: 0.184731 Jun 15 15:00:25.630375 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 349/678] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:25 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:25.888500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:25.889029 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:25.895906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.896412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:25.897172 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:25.897606 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.027624 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:26.035680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ae82b058-665a-43ac-9b53-314064e1776d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1725 microversion: 2.1 time: 0.151305 Jun 15 15:00:26.036245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 330/679] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:25 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:26.628555 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:26.629157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:26.635867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.636318 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.637084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.637526 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.649471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:26.653896 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:26.657161 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.657610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.658403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:26.659370 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:26.707051 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:26.711546 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7b29c6cf-93d1-462c-9303-2018a0e31e40 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1245 microversion: 2.1 time: 0.087044 Jun 15 15:00:26.712129 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 350/680] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:26 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:26.797207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:26.806911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f10ed428-75d3-4c86-8010-e759b730b983 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1663 microversion: 2.1 time: 0.162099 Jun 15 15:00:26.807536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 331/681] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:26 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:27.053067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:27.053721 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:27.060229 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.061035 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.062004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.062466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.212947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:27.221100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0f64fb7f-ea7f-4025-babb-17e67807cedb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1731 microversion: 2.1 time: 0.172122 Jun 15 15:00:27.228366 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 351/682] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:27 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:27.239027 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3b89f9f4-1bc0-407b-90f3-9d46a044ab8e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:27.239588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3b89f9f4-1bc0-407b-90f3-9d46a044ab8e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:27.245931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b89f9f4-1bc0-407b-90f3-9d46a044ab8e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.246081 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b89f9f4-1bc0-407b-90f3-9d46a044ab8e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.246862 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b89f9f4-1bc0-407b-90f3-9d46a044ab8e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.247296 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3b89f9f4-1bc0-407b-90f3-9d46a044ab8e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.261713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:27.326505 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3b89f9f4-1bc0-407b-90f3-9d46a044ab8e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091829 Jun 15 15:00:27.327087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 332/683] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 15:00:27 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:27.729651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:27.730440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:27.737868 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.738370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.739327 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.739770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.818908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:27.825033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:27.825650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:27.835165 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.835546 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.836324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:27.838164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:27.847109 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-800a0725-d425-4cc5-bbf9-5e206aaa3124 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1293 microversion: 2.1 time: 0.120929 Jun 15 15:00:27.856882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 352/684] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:27 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:28.002137 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:28.010164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b33938c1-fbe7-4a5b-b6ca-5bd6ca898b01 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1663 microversion: 2.1 time: 0.189422 Jun 15 15:00:28.013636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 333/685] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:27 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1663 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:28.397270 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-a6c774f2-2417-49a8-83a7-0d095251458d req-80742df6-7896-4c9b-8340-e8cac4b69dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8490a7b-6956-4086-a14b-8d892496d608", "tag": "36d09c08-3dcb-4a3b-9fc2-a993412d350d"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:28.407005 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-a6c774f2-2417-49a8-83a7-0d095251458d req-80742df6-7896-4c9b-8340-e8cac4b69dcb service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.407832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-a6c774f2-2417-49a8-83a7-0d095251458d req-80742df6-7896-4c9b-8340-e8cac4b69dcb service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.420948 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-a6c774f2-2417-49a8-83a7-0d095251458d req-80742df6-7896-4c9b-8340-e8cac4b69dcb service nova] Creating event network-changed:36d09c08-3dcb-4a3b-9fc2-a993412d350d for instance e8490a7b-6956-4086-a14b-8d892496d608 on hv-cinder-84517 Jun 15 15:00:28.426755 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-a6c774f2-2417-49a8-83a7-0d095251458d req-80742df6-7896-4c9b-8340-e8cac4b69dcb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034245 Jun 15 15:00:28.427914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 353/686] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:28.865157 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:28.865934 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:28.876512 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.882789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.882789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:28.882789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:28.949624 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:28.958559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1f2e9ed4-48fa-48c7-b747-eb8298a16d49 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1311 microversion: 2.1 time: 0.098190 Jun 15 15:00:28.959137 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 334/687] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:28 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:29.029283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:29.030109 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:29.037333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.037788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:29.038597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.039035 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:29.176240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:29.184966 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-02a00594-6ab1-4b69-9d2a-b5fd8d5c804c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1667 microversion: 2.1 time: 0.160157 Jun 15 15:00:29.185581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 354/688] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:29 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:29.981340 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:29.982401 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:29.989668 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.990250 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:29.993007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:29.993688 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.083595 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:30.091873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e96500ba-c47a-4f0a-ab74-4c3e8ff5ce72 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1299 microversion: 2.1 time: 0.114458 Jun 15 15:00:30.092457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 335/689] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:29 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:30.443047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-4ad92b24-81cd-4b2e-a19a-b0c14215e42c req-ff2b3c29-c107-499f-99cc-3f39356041c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8490a7b-6956-4086-a14b-8d892496d608", "tag": "36d09c08-3dcb-4a3b-9fc2-a993412d350d"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:30.451880 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-4ad92b24-81cd-4b2e-a19a-b0c14215e42c req-ff2b3c29-c107-499f-99cc-3f39356041c2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:30.452324 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-4ad92b24-81cd-4b2e-a19a-b0c14215e42c req-ff2b3c29-c107-499f-99cc-3f39356041c2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:30.454971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:30.464748 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-4ad92b24-81cd-4b2e-a19a-b0c14215e42c req-ff2b3c29-c107-499f-99cc-3f39356041c2 service nova] Creating event network-changed:36d09c08-3dcb-4a3b-9fc2-a993412d350d for instance e8490a7b-6956-4086-a14b-8d892496d608 on hv-cinder-84517 Jun 15 15:00:30.469515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-4ad92b24-81cd-4b2e-a19a-b0c14215e42c req-ff2b3c29-c107-499f-99cc-3f39356041c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031242 Jun 15 15:00:30.470104 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 355/690] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:31.074698 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:31.075993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:31.084949 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.085735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.086851 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.087715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.111132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:31.111960 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:31.122119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.126347 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.127860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.128757 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.195663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lazy-loading 'services' on Instance uuid b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:31.307429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:31.315206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b7556494-8cbb-41f5-bb89-61123034cf8c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.208625 Jun 15 15:00:31.316364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 356/691] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:31 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:31.402028 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-cb700523-7c53-49b8-bec8-9c21a1f0763b req-2e678c13-01af-4794-a730-85c36c63fd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "213535cc-ae46-43b2-ad12-f49fc89e13b2", "tag": "baf8202d-6ebd-4dab-ba4d-7b7adc881bc9"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:31.412208 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-cb700523-7c53-49b8-bec8-9c21a1f0763b req-2e678c13-01af-4794-a730-85c36c63fd5e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:31.412708 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-cb700523-7c53-49b8-bec8-9c21a1f0763b req-2e678c13-01af-4794-a730-85c36c63fd5e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:31.428377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-cb700523-7c53-49b8-bec8-9c21a1f0763b req-2e678c13-01af-4794-a730-85c36c63fd5e service nova] Creating event network-changed:baf8202d-6ebd-4dab-ba4d-7b7adc881bc9 for instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 on hv-cinder-84517 Jun 15 15:00:31.434467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-cb700523-7c53-49b8-bec8-9c21a1f0763b req-2e678c13-01af-4794-a730-85c36c63fd5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037380 Jun 15 15:00:31.435252 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 357/692] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:31.483687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-867949a4-bac1-43c7-a096-f336193f0be2 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6/os-volume_attachments/299b4f2f-1596-479b-b38a-f6ec15b463c7" status: 202 len: 0 microversion: 2.1 time: 0.413375 Jun 15 15:00:31.489482 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 336/693] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:00:31 2022] DELETE /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6/os-volume_attachments/299b4f2f-1596-479b-b38a-f6ec15b463c7 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:00:32.330706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:32.334861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:32.335572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:32.341719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.343467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.343467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:32.343467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:32.484398 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:32.492605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-900ac541-df2d-415a-9948-e49d0001ed63 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.163474 Jun 15 15:00:32.493168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 358/694] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:32 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:33.506112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:33.507370 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=10 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:33.511487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:33.512184 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:33.518465 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.518911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.519667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.520098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.654888 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:33.663262 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ea994322-e212-4d9b-a194-4c090abdc362 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.158095 Jun 15 15:00:33.663813 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 337/695] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:33 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:33.667515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:33.668025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:33.675505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.693898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.693898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:33.693898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:33.704195 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:00:34.000314 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:34.101170 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-df7a3c84-f208-40c4-abea-c4b215817cc9 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 204 len: 0 microversion: 2.1 time: 0.437225 Jun 15 15:00:34.101779 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 359/696] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:00:33 2022] DELETE /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:00:34.110545 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:34.111191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:34.118159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.118629 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.119387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.119819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.247603 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.256661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5e0a28ae-1923-45bb-ba38-6dc8a5c780c6 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1561 microversion: 2.1 time: 0.150572 Jun 15 15:00:34.257153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 338/697] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:34 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:34.681023 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:34.681733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:34.688442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.690487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.690487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:34.690487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:34.818348 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:34.825851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f72cd241-6b85-4fd4-acd5-d765be2dfedd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.149343 Jun 15 15:00:34.826457 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 360/698] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:34 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:35.273105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:35.273739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:35.280353 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.280803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.281562 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.281999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.411002 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:35.418368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3f3ff9df-bf68-417c-90ee-6493efc02095 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1515 microversion: 2.1 time: 0.149107 Jun 15 15:00:35.418930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 339/699] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:35 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:35.843612 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:35.844153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:35.851085 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.851595 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.852361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:35.853236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:35.988293 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:35.995660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9210c925-1d34-4738-b11b-81f1f5027fb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.156190 Jun 15 15:00:35.996231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 361/700] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:35 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:36.436312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:36.436934 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:36.443625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.444075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.444839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:36.445277 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:36.593930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:36.593930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6da3f41e-6c43-44ee-b394-79b95beda1e7 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1515 microversion: 2.1 time: 0.158134 Jun 15 15:00:36.593930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 340/701] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:36 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:37.012940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:37.013482 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:37.020517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.021080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.021851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.022306 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.152071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:37.160207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-82882cca-f7ca-44ae-b707-c5978e802e38 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.151256 Jun 15 15:00:37.160780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 362/702] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:37 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:37.608427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:37.609037 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:37.616309 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.618531 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.618531 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.618531 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.684244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-9033660b-c5db-424f-bed6-022ba27bd0cb req-4e53183e-c149-4247-bde8-bc8d27ea052a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6", "name": "network-vif-deleted", "tag": "0731b3fa-6348-4cc8-94af-8650cd4ace46"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:37.693873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-9033660b-c5db-424f-bed6-022ba27bd0cb req-4e53183e-c149-4247-bde8-bc8d27ea052a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:37.694353 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-9033660b-c5db-424f-bed6-022ba27bd0cb req-4e53183e-c149-4247-bde8-bc8d27ea052a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:37.705531 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-9033660b-c5db-424f-bed6-022ba27bd0cb req-4e53183e-c149-4247-bde8-bc8d27ea052a service nova] Creating event network-vif-deleted:0731b3fa-6348-4cc8-94af-8650cd4ace46 for instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 on hv-cinder-84517 Jun 15 15:00:37.710150 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-9033660b-c5db-424f-bed6-022ba27bd0cb req-4e53183e-c149-4247-bde8-bc8d27ea052a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029786 Jun 15 15:00:37.710959 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 363/703] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:37.802311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:37.811115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0365cd02-7616-4491-9aef-0bc441fc2f56 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1473 microversion: 2.1 time: 0.206746 Jun 15 15:00:37.811846 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 341/704] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:37 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1473 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:38.177934 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:38.179181 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:38.190608 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.190608 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.190608 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.190608 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.326942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:38.334690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-085cd0ad-6164-4b2b-9ffa-d9d6739ab4af tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.162121 Jun 15 15:00:38.335258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 364/705] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:38 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:38.828627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-780430d5-5c92-445d-8c73-93ce4bbd88b3 req-ce78343f-897d-417a-a55f-e5e702717512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213535cc-ae46-43b2-ad12-f49fc89e13b2", "name": "network-vif-plugged", "status": "completed", "tag": "baf8202d-6ebd-4dab-ba4d-7b7adc881bc9"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:38.833089 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:38.834050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:38.838217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:38.841186 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.841641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.842498 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.842985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-780430d5-5c92-445d-8c73-93ce4bbd88b3 req-ce78343f-897d-417a-a55f-e5e702717512 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.843118 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.843430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-780430d5-5c92-445d-8c73-93ce4bbd88b3 req-ce78343f-897d-417a-a55f-e5e702717512 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.857983 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-780430d5-5c92-445d-8c73-93ce4bbd88b3 req-ce78343f-897d-417a-a55f-e5e702717512 service nova] Creating event network-vif-plugged:baf8202d-6ebd-4dab-ba4d-7b7adc881bc9 for instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 on hv-cinder-84517 Jun 15 15:00:38.864077 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-780430d5-5c92-445d-8c73-93ce4bbd88b3 req-ce78343f-897d-417a-a55f-e5e702717512 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039573 Jun 15 15:00:38.865046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 342/706] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:38.881756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:38.882230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:38.882686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lazy-loading 'fault' on Instance uuid b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:38.926795 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9c4ff3d13d4332837f519214b9df37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421ba5fd9c9d4ea0b3b3dd89069aabb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:38.937199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0e07fee2-d752-48cd-b957-7a4a9b278743 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 200 len: 1309 microversion: 2.1 time: 0.109408 Jun 15 15:00:38.937781 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 365/707] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:38 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:00:39.353306 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:39.354099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:39.360473 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.361687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.362769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.363206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.496356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:39.504030 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8b824b83-d913-4950-828d-c21e7dc9db14 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.155490 Jun 15 15:00:39.504606 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 343/708] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:39 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:39.956159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:39.956751 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] [instance: b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:39.963293 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.963741 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.964495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:39.964924 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:39.978569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] HTTP exception thrown: Instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 could not be found. Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Request method failure captured: Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 HTTP/1.1 Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfNVlTL0hQecZQZzRqcvDMJIenRrL0zNFm31ZbkUBRpP5suH6nRrxsuLEKq2nNwbkjmRKkO0PwPoZ4ytOUZk1siCU5DxQ8QADcVCmtCb5rgZM78ZWD8bVe_RTF5-I2F-HWtEGYUIvLF1GUYjkoWSL6LFnIbkK_zQDi4bNJSxLS7W_Zo Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 421ba5fd9c9d4ea0b3b3dd89069aabb2 Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1182676647 Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:00:39.980429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/421ba5fd9c9d4ea0b3b3dd89069aabb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-VolumesSnapshotTestJSON-1182676647 Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 421ba5fd9c9d4ea0b3b3dd89069aabb2 Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1182676647 Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-VolumesSnapshotTestJSON-1182676647-project Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 4e9c4ff3d13d4332837f519214b9df37 Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-VolumesSnapshotTestJSON-1182676647-project Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 could not be found. Jun 15 15:00:39.995418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6'} Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 could not be found. Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:39.996268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 could not be found. Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 could not be found. Jun 15 15:00:39.997797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:00:39.999345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] Returning 404 to user: Instance b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:39.999345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4e489d17-1b33-4253-be36-3ed9e2f59311 tempest-VolumesSnapshotTestJSON-1182676647 tempest-VolumesSnapshotTestJSON-1182676647-project] 10.222.0.23 "GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6" status: 404 len: 111 microversion: 2.1 time: 0.029968 Jun 15 15:00:39.999345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 366/709] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:39 2022] GET /compute/v2.1/servers/b61ca3d0-7ef5-4149-b416-1e2e99bcb8a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:00:40.521251 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:40.521811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:40.528573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:40.529054 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:40.534094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:40.534094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:40.676414 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:40.683825 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-86abb0a8-3c04-4dca-8455-02ec2980a3d2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1367 microversion: 2.1 time: 0.166876 Jun 15 15:00:40.684390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 344/710] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:40 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:41.700917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:41.701535 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:41.709191 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.709661 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.710456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.710885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.909927 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:41.917732 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b06d1a1b-7821-44a2-a54d-3e9063278bb7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1557 microversion: 2.1 time: 0.220800 Jun 15 15:00:41.918310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 367/711] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:00:41 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:41.934476 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bad260fb-f382-4436-8a9f-8f17474c93f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:41.934978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bad260fb-f382-4436-8a9f-8f17474c93f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:41.942105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad260fb-f382-4436-8a9f-8f17474c93f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.942613 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad260fb-f382-4436-8a9f-8f17474c93f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:41.943404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad260fb-f382-4436-8a9f-8f17474c93f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:41.943845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bad260fb-f382-4436-8a9f-8f17474c93f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:42.024565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bad260fb-f382-4436-8a9f-8f17474c93f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093927 Jun 15 15:00:42.025157 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 345/712] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 15:00:41 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:43.241522 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-d6708fb8-80cd-49ef-87a5-26b62d8257e0 req-9e0f8024-260d-4e00-94fd-245693fe1919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "213535cc-ae46-43b2-ad12-f49fc89e13b2", "tag": "baf8202d-6ebd-4dab-ba4d-7b7adc881bc9"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:43.250076 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d6708fb8-80cd-49ef-87a5-26b62d8257e0 req-9e0f8024-260d-4e00-94fd-245693fe1919 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:43.250572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d6708fb8-80cd-49ef-87a5-26b62d8257e0 req-9e0f8024-260d-4e00-94fd-245693fe1919 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:43.261933 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-d6708fb8-80cd-49ef-87a5-26b62d8257e0 req-9e0f8024-260d-4e00-94fd-245693fe1919 service nova] Creating event network-changed:baf8202d-6ebd-4dab-ba4d-7b7adc881bc9 for instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 on hv-cinder-84517 Jun 15 15:00:43.267972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-d6708fb8-80cd-49ef-87a5-26b62d8257e0 req-9e0f8024-260d-4e00-94fd-245693fe1919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029178 Jun 15 15:00:43.268562 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 368/713] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:00:48.353750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c7efd8a2-d9f4-4dcf-b890-2c4f1e16d60e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:48.354407 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c7efd8a2-d9f4-4dcf-b890-2c4f1e16d60e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:48.360836 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c7efd8a2-d9f4-4dcf-b890-2c4f1e16d60e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.361360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c7efd8a2-d9f4-4dcf-b890-2c4f1e16d60e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.362239 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c7efd8a2-d9f4-4dcf-b890-2c4f1e16d60e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.362739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c7efd8a2-d9f4-4dcf-b890-2c4f1e16d60e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.395368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c7efd8a2-d9f4-4dcf-b890-2c4f1e16d60e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments/bdc05669-d8ab-4bb8-984b-4450e966f663" status: 200 len: 194 microversion: 2.20 time: 0.047089 Jun 15 15:00:48.396026 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 346/714] 10.222.0.23 () {60 vars in 1453 bytes} [Wed Jun 15 15:00:48 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments/bdc05669-d8ab-4bb8-984b-4450e966f663 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:00:48.460347 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:48.460933 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:48.468032 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.468481 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.469834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.470319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.552340 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lazy-loading 'services' on Instance uuid 77f6014d-9ea6-47c4-af6c-719e09d8d193 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:48.796219 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a746020b-c410-4a06-a8a0-a6a5650d0e49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments/bdc05669-d8ab-4bb8-984b-4450e966f663" status: 202 len: 0 microversion: 2.20 time: 0.339935 Jun 15 15:00:48.796837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 369/715] 10.222.0.23 () {60 vars in 1456 bytes} [Wed Jun 15 15:00:48 2022] DELETE /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments/bdc05669-d8ab-4bb8-984b-4450e966f663 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:00:48.806852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-adb37f9b-462a-4049-ae84-578894cd41d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:48.807896 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-adb37f9b-462a-4049-ae84-578894cd41d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:48.814508 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adb37f9b-462a-4049-ae84-578894cd41d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.815010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adb37f9b-462a-4049-ae84-578894cd41d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.815778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adb37f9b-462a-4049-ae84-578894cd41d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:48.816232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adb37f9b-462a-4049-ae84-578894cd41d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:48.851331 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-adb37f9b-462a-4049-ae84-578894cd41d9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049201 Jun 15 15:00:48.852020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 347/716] 10.222.0.23 () {60 vars in 1342 bytes} [Wed Jun 15 15:00:48 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:00:49.919515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-58ec8e6c-4765-4025-86b2-b58840d7b29c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:49.920694 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-58ec8e6c-4765-4025-86b2-b58840d7b29c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:49.927564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-58ec8e6c-4765-4025-86b2-b58840d7b29c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.928017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-58ec8e6c-4765-4025-86b2-b58840d7b29c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.928783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-58ec8e6c-4765-4025-86b2-b58840d7b29c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:49.929224 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-58ec8e6c-4765-4025-86b2-b58840d7b29c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:49.958575 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-58ec8e6c-4765-4025-86b2-b58840d7b29c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098354 Jun 15 15:00:49.959147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 370/717] 10.222.0.23 () {60 vars in 1342 bytes} [Wed Jun 15 15:00:49 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:00:50.970897 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c84eb74a-241f-4d5a-ad1a-4b565d6b0485 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:50.971848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c84eb74a-241f-4d5a-ad1a-4b565d6b0485 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:50.978502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c84eb74a-241f-4d5a-ad1a-4b565d6b0485 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:50.978960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c84eb74a-241f-4d5a-ad1a-4b565d6b0485 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:50.979815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c84eb74a-241f-4d5a-ad1a-4b565d6b0485 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:50.980255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c84eb74a-241f-4d5a-ad1a-4b565d6b0485 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.010262 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c84eb74a-241f-4d5a-ad1a-4b565d6b0485 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043595 Jun 15 15:00:51.010744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 348/718] 10.222.0.23 () {60 vars in 1342 bytes} [Wed Jun 15 15:00:50 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:00:51.073113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:51.073611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:51.080492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.080947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.081707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.082143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.107469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:00:51.134049 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:51.517617 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fa4ef45c-f659-4172-8ca1-be1368697bca tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 204 len: 0 microversion: 2.20 time: 0.447937 Jun 15 15:00:51.518115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 371/719] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Jun 15 15:00:51 2022] DELETE /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 15:00:51.526788 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:51.527390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:51.534967 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.535412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.536174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:51.536607 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:51.671577 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.674592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:00:51.681009 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.682544 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:51.683695 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-460b34ef-430d-4be8-9ded-0cdc3f072205 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.160826 Jun 15 15:00:51.684242 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 349/720] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:51 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:52.703615 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:52.708264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:52.711187 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.711659 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.712414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:52.712845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:52.853636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:52.862835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:52.864388 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:52.865556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-acf1fdb4-c7b9-43c0-9def-a48c3fc90aa4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.166645 Jun 15 15:00:52.866112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 372/721] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:52 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:53.884527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:53.885157 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:53.892973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:53.893425 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:53.894228 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:53.894673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:54.038278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:54.046303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:54.048320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:54.049476 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-819f5f99-0b28-42e5-9d60-0777e2d1022c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.169223 Jun 15 15:00:54.050043 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 350/722] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:53 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:55.068170 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:55.068790 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:55.075740 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:55.076184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:55.076941 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:55.077373 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:55.226485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:55.234485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:55.235983 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:55.237151 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-994ab446-feda-485e-b4be-f26cc07b382f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.172986 Jun 15 15:00:55.237698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 373/723] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:55 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:56.257427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:56.258028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:56.264511 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:56.264960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:56.266869 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:56.267303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:56.405972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:56.416655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:56.416655 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:56.417423 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b1f1fdc9-6d9d-48d6-8c6e-55774fa910d1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.163956 Jun 15 15:00:56.417984 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 351/724] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:56 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:57.454696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:57.454696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:57.454696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:57.454696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:57.455858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:57.455858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:57.583547 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:57.592967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:57.595652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:57.597038 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2b4dd069-ab48-4bcd-a0c0-42af13abd100 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1724 microversion: 2.20 time: 0.164973 Jun 15 15:00:57.597780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 374/725] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:57 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:58.166223 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-7c3dfbf3-8b24-45da-9cf4-1a9909c6e208 req-367c5248-c6df-4535-9158-e79f8bd02b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6014d-9ea6-47c4-af6c-719e09d8d193", "name": "network-vif-deleted", "tag": "08f6804f-9163-46e0-a8a3-e6d5513b1c44"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:00:58.178666 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-7c3dfbf3-8b24-45da-9cf4-1a9909c6e208 req-367c5248-c6df-4535-9158-e79f8bd02b8b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:58.179380 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-7c3dfbf3-8b24-45da-9cf4-1a9909c6e208 req-367c5248-c6df-4535-9158-e79f8bd02b8b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:58.194315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-7c3dfbf3-8b24-45da-9cf4-1a9909c6e208 req-367c5248-c6df-4535-9158-e79f8bd02b8b service nova] Creating event network-vif-deleted:08f6804f-9163-46e0-a8a3-e6d5513b1c44 for instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 on hv-cinder-84517 Jun 15 15:00:58.199666 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-7c3dfbf3-8b24-45da-9cf4-1a9909c6e208 req-367c5248-c6df-4535-9158-e79f8bd02b8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109046 Jun 15 15:00:58.204732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 352/726] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:00:58.616102 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:58.616789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:58.622942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:58.630651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:58.630651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:58.630651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:58.657164 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:58.657613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:58.658072 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lazy-loading 'fault' on Instance uuid 77f6014d-9ea6-47c4-af6c-719e09d8d193 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:00:58.702088 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:58.711101 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:58.712623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:00:58.713971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-efdfca77-2e9d-4191-aafa-926a4b124a42 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 200 len: 1371 microversion: 2.20 time: 0.102108 Jun 15 15:00:58.714635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 375/727] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:58 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:00:59.735271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:59.736552 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:00:59.744489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:59.744921 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:59.746691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:00:59.746691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:00:59.760933 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] HTTP exception thrown: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Request method failure captured: Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 HTTP/1.1 Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfL1WmLQfeD1ak5dH1auFzRh9miLxkUjG5H_AAIScREgNtusQeaZTJi3cb1qft-ndiYP41okwXnoJtPzhfUiVCFWm0dTGcroJFigBrt4Pmfm4LLgDX5kL8wiC5CnuIomNIPlJfUvLOoyr6OnGvACCAxT4ES8axCgUGewfIb3wk8BIdQ Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:00:59.762630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: bf1b5d8cbfbb450da8878719c4aa6712 Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:00:59.764321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '77f6014d-9ea6-47c4-af6c-719e09d8d193'} Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:00:59.765271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:00:59.767675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:00:59.769032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Returning 404 to user: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:00:59.769032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e00ba590-d6ad-4b9f-a7d5-969147e13181 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 404 len: 111 microversion: 2.20 time: 0.034690 Jun 15 15:00:59.769032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 353/728] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:00:59 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:00:59.775211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9f932467-0218-45c0-82cc-400548952fd4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '.version_select at 0x7f693a2054c0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:00:59.919577 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9f932467-0218-45c0-82cc-400548952fd4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061284394" status: 204 len: 0 microversion: 2.20 time: 0.149045 Jun 15 15:00:59.920377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 376/729] 10.222.0.23 () {60 vars in 1261 bytes} [Wed Jun 15 15:00:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061284394 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 15:01:00.969174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d92065f6-6f3d-48c4-b8d4-64294f398a15 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'create', calling method: .version_select at 0x7f693aa4c9d0>, body: {"keypair": {"name": "tempest-keypair-1275100580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElnEKmzAoh4w2UVu12QXklGS/2ZaHszPu8Q4ewKZm1PkZBhoAOpFAjEm7umcaeQ9JtdcyT8bBWNGoiN8QGV+oQLfjDJNi6l760Bg47i8dPRYSVk+15q+Gr0y75n8U0Eug=="}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:00.983361 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-d92065f6-6f3d-48c4-b8d4-64294f398a15 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:00.987748 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-d92065f6-6f3d-48c4-b8d4-64294f398a15 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for user bf1b5d8cbfbb450da8878719c4aa6712 and project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:01.072131 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d92065f6-6f3d-48c4-b8d4-64294f398a15 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.106925 Jun 15 15:01:01.072720 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 354/730] 10.222.0.23 () {62 vars in 1199 bytes} [Wed Jun 15 15:01:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 15:01:03.983023 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-278866643", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73440024-15c7-43b4-be7e-06dddac720f4"}], "security_groups": [{"name": "tempest-securitygroup--2108672556"}], "key_name": "tempest-keypair-1275100580", "user_data": "}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:04.088439 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] validate_networks() for [('73440024-15c7-43b4-be7e-06dddac720f4', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:01:04.533840 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:01:04.534346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:01:04.534834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:01:04.535256 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:01:04.535676 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:01:04.544486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:04.544938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:04.545847 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:04.546450 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:04.563548 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:04.567544 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Getting quotas for user bf1b5d8cbfbb450da8878719c4aa6712 and project 5f7ed2c773bd43c7a0845599bfb902ec. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:04.579118 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:01:04.581401 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:01:04.731558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-16c23876-3465-4fcc-abd6-dfe25363a00f tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.753524 Jun 15 15:01:04.732357 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 377/731] 10.222.0.23 () {62 vars in 1187 bytes} [Wed Jun 15 15:01:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 15:01:04.743776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5341033f-f7a1-463c-8d09-faf22b318824 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:04.744383 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5341033f-f7a1-463c-8d09-faf22b318824 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:04.803677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5341033f-f7a1-463c-8d09-faf22b318824 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:04.816496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5341033f-f7a1-463c-8d09-faf22b318824 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:04.816496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5341033f-f7a1-463c-8d09-faf22b318824 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:04.824038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5341033f-f7a1-463c-8d09-faf22b318824 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1281 microversion: 2.20 time: 0.078256 Jun 15 15:01:04.824038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 355/732] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:04 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:05.843073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ee81de69-d694-4976-aa17-49ecfd8b4870 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:05.844132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ee81de69-d694-4976-aa17-49ecfd8b4870 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:05.846273 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:05.904260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ee81de69-d694-4976-aa17-49ecfd8b4870 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:05.909722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ee81de69-d694-4976-aa17-49ecfd8b4870 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:05.911295 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ee81de69-d694-4976-aa17-49ecfd8b4870 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:05.912405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ee81de69-d694-4976-aa17-49ecfd8b4870 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1281 microversion: 2.20 time: 0.074427 Jun 15 15:01:05.912967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 378/733] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:05 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:06.931201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:06.931793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:06.939444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:06.939891 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:06.940658 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:06.941097 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:07.004490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:07.012723 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:07.014320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:07.015440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-150063ac-74d6-47af-b3c5-c955076d693a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1277 microversion: 2.20 time: 0.088157 Jun 15 15:01:07.016057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 356/734] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:06 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:08.034300 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:08.035202 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:08.044111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:08.044600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:08.045421 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:08.045870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:08.115235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:08.124001 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:08.125588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:08.126764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-03f5c3f7-1cb9-434f-b2ef-374da15ecccb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1351 microversion: 2.20 time: 0.097831 Jun 15 15:01:08.127561 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 379/735] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:08 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:09.145776 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:09.146356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:09.153256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:09.153833 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:09.154511 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:09.155877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:09.321929 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:09.330572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:09.332082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:09.333199 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cf459ba6-19ab-481f-9e5d-49e83784a223 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.191584 Jun 15 15:01:09.333758 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 357/736] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:09 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:10.138096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-fd2d3413-857f-4d82-8088-6d9418d29096 req-d27b233d-adde-46b1-b28f-a5cd607fa721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1", "tag": "3c15b40b-3126-4ab0-8e3c-b2ed2188737c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:10.164265 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-fd2d3413-857f-4d82-8088-6d9418d29096 req-d27b233d-adde-46b1-b28f-a5cd607fa721 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:10.164725 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-fd2d3413-857f-4d82-8088-6d9418d29096 req-d27b233d-adde-46b1-b28f-a5cd607fa721 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:10.178062 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-fd2d3413-857f-4d82-8088-6d9418d29096 req-d27b233d-adde-46b1-b28f-a5cd607fa721 service nova] Creating event network-changed:3c15b40b-3126-4ab0-8e3c-b2ed2188737c for instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 on hv-cinder-84517 Jun 15 15:01:10.183118 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-fd2d3413-857f-4d82-8088-6d9418d29096 req-d27b233d-adde-46b1-b28f-a5cd607fa721 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051820 Jun 15 15:01:10.183724 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 380/737] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:10.354481 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:10.356266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:10.360722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:10.364970 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:10.365601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:10.366624 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:10.367057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:10.621722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:10.631179 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:10.632640 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:10.633760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bdae816a-d7e9-4744-ade4-339a99254478 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.284623 Jun 15 15:01:10.634786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 358/738] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:10 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:11.653923 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:11.655811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:11.669762 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:11.671093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:11.671943 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:11.672387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:11.873518 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:11.881622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:11.883167 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:11.884299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-29cb84da-a89f-4eef-9fea-604885f0c5d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.235332 Jun 15 15:01:11.885034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 381/739] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:11 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:12.902973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:12.903760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:12.910674 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:12.911190 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:12.911938 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:12.912380 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:13.047160 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:13.055542 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:13.057050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:13.058194 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-88936836-0966-4c08-87b4-ce7c06932684 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.159243 Jun 15 15:01:13.058752 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 359/740] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:12 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:14.077272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:14.077878 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:14.084479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:14.084928 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:14.085688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:14.086785 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:14.215730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:14.224759 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:14.226311 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:14.227528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b3da9522-6e52-471e-9f67-d745ce7d5240 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.154404 Jun 15 15:01:14.228095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 382/741] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:14 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:15.245269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:15.246562 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:15.259559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=6 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:15.259559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:15.259559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:15.259559 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:15.259971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:15.416930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:15.432249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:15.437092 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:15.440166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0b51d499-ec44-4572-96ce-812adee942b8 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.199167 Jun 15 15:01:15.442957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 360/742] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:15 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:16.349842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:16.350466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:16.353618 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:16.355086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=8 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:16.360005 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.360527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.361375 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.362020 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.458674 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lazy-loading 'services' on Instance uuid e8490a7b-6956-4086-a14b-8d892496d608 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:16.461601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:16.464333 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:16.475361 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.476217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.478027 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.478983 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.683233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:16.691770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:16.693287 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:16.694431 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5b4eeb49-6ff3-4c90-9e13-bf88fa23626d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.238884 Jun 15 15:01:16.695197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 361/743] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:16 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:16.813293 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fffe9bf7-bf6c-4f80-95ed-1a35dada4fd2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments/b34a2b06-f3a4-43f0-b9be-29d43959e90c" status: 202 len: 0 microversion: 2.1 time: 0.469336 Jun 15 15:01:16.813884 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 383/744] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:01:16 2022] DELETE /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments/b34a2b06-f3a4-43f0-b9be-29d43959e90c => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:01:16.828373 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-857555b9-c883-4044-a72d-1cde37e305bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:16.829899 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-857555b9-c883-4044-a72d-1cde37e305bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:16.836444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-857555b9-c883-4044-a72d-1cde37e305bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.837020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-857555b9-c883-4044-a72d-1cde37e305bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.837889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-857555b9-c883-4044-a72d-1cde37e305bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:16.838696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-857555b9-c883-4044-a72d-1cde37e305bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:16.871782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-857555b9-c883-4044-a72d-1cde37e305bb tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049807 Jun 15 15:01:16.872601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 362/745] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:16 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:17.621045 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-006e3293-2949-4601-9ddc-ae3731a9785b req-da23af29-a8a6-4ee3-a4b7-e6868a5646f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1", "name": "network-vif-plugged", "status": "completed", "tag": "3c15b40b-3126-4ab0-8e3c-b2ed2188737c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:17.631533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-006e3293-2949-4601-9ddc-ae3731a9785b req-da23af29-a8a6-4ee3-a4b7-e6868a5646f6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:17.635349 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-006e3293-2949-4601-9ddc-ae3731a9785b req-da23af29-a8a6-4ee3-a4b7-e6868a5646f6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:17.644842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-006e3293-2949-4601-9ddc-ae3731a9785b req-da23af29-a8a6-4ee3-a4b7-e6868a5646f6 service nova] Creating event network-vif-plugged:3c15b40b-3126-4ab0-8e3c-b2ed2188737c for instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 on hv-cinder-84517 Jun 15 15:01:17.651222 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-006e3293-2949-4601-9ddc-ae3731a9785b req-da23af29-a8a6-4ee3-a4b7-e6868a5646f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171933 Jun 15 15:01:17.652319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 384/746] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:17.716169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:17.717993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:17.728283 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:17.728979 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:17.730156 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:17.731763 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:17.894069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-473617b3-7bc0-48ad-8fbb-23a13366ae65 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:17.894069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-473617b3-7bc0-48ad-8fbb-23a13366ae65 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:17.894760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-473617b3-7bc0-48ad-8fbb-23a13366ae65 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:17.895322 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-473617b3-7bc0-48ad-8fbb-23a13366ae65 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:17.896111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-473617b3-7bc0-48ad-8fbb-23a13366ae65 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:17.896547 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-473617b3-7bc0-48ad-8fbb-23a13366ae65 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:17.918231 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:17.931259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:17.932877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:17.933422 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-473617b3-7bc0-48ad-8fbb-23a13366ae65 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053921 Jun 15 15:01:17.934122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e505c9bd-82a9-44c1-9f8b-ba0a7d0b304c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.224807 Jun 15 15:01:17.934291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 385/747] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:17 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:17.935880 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 363/748] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:17 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:18.945116 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1677f30d-bf33-48bf-ac40-ec9b23d28e52 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:18.959351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1677f30d-bf33-48bf-ac40-ec9b23d28e52 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:18.959760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:18.960209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1677f30d-bf33-48bf-ac40-ec9b23d28e52 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:18.960209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1677f30d-bf33-48bf-ac40-ec9b23d28e52 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:18.960406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:18.960505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1677f30d-bf33-48bf-ac40-ec9b23d28e52 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:18.960505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1677f30d-bf33-48bf-ac40-ec9b23d28e52 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:18.960677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:18.960945 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:18.961727 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:18.962166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:18.989359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1677f30d-bf33-48bf-ac40-ec9b23d28e52 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048272 Jun 15 15:01:18.995297 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 386/749] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:18 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:01:19.078159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:19.078999 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:19.085354 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.086138 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.087788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.088445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.119426 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:01:19.175298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:19.192506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:19.194017 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:19.195180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dad9511d-4e88-4128-ba5b-38e7f38bd6aa tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.246201 Jun 15 15:01:19.198270 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 364/750] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:18 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:01:19.492867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-505dc1c4-c0fb-4f6c-8604-4867816ad887 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 204 len: 0 microversion: 2.1 time: 0.418890 Jun 15 15:01:19.494003 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 387/751] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:19 2022] DELETE /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:01:19.507219 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:19.507972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:19.515454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.515907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.516685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:19.517119 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:19.673108 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:19.681456 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f2d4303f-7769-480d-bfc0-8dec24e01b19 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1691 microversion: 2.1 time: 0.177993 Jun 15 15:01:19.682239 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 365/752] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:19 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:20.213811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:20.215173 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:20.221818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:20.222708 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:20.223613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:20.224161 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:20.367976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:20.372238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:20.379428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:20.385456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:20.385456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b5f7ee12-ee57-4afe-bf74-7abcf4f5d035 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1407 microversion: 2.20 time: 0.172794 Jun 15 15:01:20.385456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 388/753] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:20 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:20.699550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:20.700315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:20.708812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:20.709267 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:20.710074 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:20.710541 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:20.859080 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:20.866708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b218a345-3c9f-4825-9f75-a9a02f1316f7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1691 microversion: 2.1 time: 0.171305 Jun 15 15:01:20.867269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 366/754] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:20 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:21.401509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:21.402120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:21.411817 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:21.412590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:21.413996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:21.415522 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:21.885696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:21.886944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:21.903773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:21.909142 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:21.911393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:21.912198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.310218 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:22.320777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:22.323111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:22.324389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5cc31217-3386-4d20-8a95-8f5b18b0c30d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1599 microversion: 2.20 time: 0.927224 Jun 15 15:01:22.324947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 389/755] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:01:21 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1599 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:01:22.339366 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-80ad303b-d107-4acc-9b5b-f7178c94ddc7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:22.340303 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-80ad303b-d107-4acc-9b5b-f7178c94ddc7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:22.346206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:22.348284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80ad303b-d107-4acc-9b5b-f7178c94ddc7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.348914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80ad303b-d107-4acc-9b5b-f7178c94ddc7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.349952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80ad303b-d107-4acc-9b5b-f7178c94ddc7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.350486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80ad303b-d107-4acc-9b5b-f7178c94ddc7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.355175 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-284445d8-7915-4675-93a6-0114e697d6f8 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1691 microversion: 2.1 time: 0.475178 Jun 15 15:01:22.365161 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 367/756] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:21 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1691 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:22.370378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7ba0578e-a4d9-48ac-b4c5-f665c88465ac tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:22.374823 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7ba0578e-a4d9-48ac-b4c5-f665c88465ac tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:22.377974 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ba0578e-a4d9-48ac-b4c5-f665c88465ac tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.378526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ba0578e-a4d9-48ac-b4c5-f665c88465ac tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.379397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ba0578e-a4d9-48ac-b4c5-f665c88465ac tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.379894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ba0578e-a4d9-48ac-b4c5-f665c88465ac tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.392483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-80ad303b-d107-4acc-9b5b-f7178c94ddc7 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065560 Jun 15 15:01:22.393267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 390/757] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:22 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:01:22.464739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:22.466260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:22.477285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.478015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.479515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.480025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.524399 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:01:22.582134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7ba0578e-a4d9-48ac-b4c5-f665c88465ac tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.215695 Jun 15 15:01:22.582863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 368/758] 10.222.0.23 () {60 vars in 1315 bytes} [Wed Jun 15 15:01:22 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:01:22.909056 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-209a29c1-396e-4aa9-9fd4-842701eb40b2 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 204 len: 0 microversion: 2.1 time: 0.450251 Jun 15 15:01:22.913356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 391/759] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:22 2022] DELETE /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:01:22.918470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:22.919730 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:22.931805 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.932268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:22.933063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:22.933507 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.152514 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:23.162903 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-921ffb8c-3349-4231-9a03-4319046e66c0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1673 microversion: 2.1 time: 0.247380 Jun 15 15:01:23.163976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 369/760] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:22 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:23.374503 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:23.375504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:23.384059 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.384518 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.385312 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.385939 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.599991 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:23.608475 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-dca1672e-36f6-4833-b2f8-12040902bd4d tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1691 microversion: 2.1 time: 0.239447 Jun 15 15:01:23.609051 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 392/761] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:23 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:23.821848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-e5620eb6-2596-4866-9602-deac08705153 req-286fabc8-add1-4306-954e-6f5cb8e37c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1", "tag": "3c15b40b-3126-4ab0-8e3c-b2ed2188737c"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:23.831804 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-e5620eb6-2596-4866-9602-deac08705153 req-286fabc8-add1-4306-954e-6f5cb8e37c20 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:23.832261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-e5620eb6-2596-4866-9602-deac08705153 req-286fabc8-add1-4306-954e-6f5cb8e37c20 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:23.836910 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=100 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:23.851201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-e5620eb6-2596-4866-9602-deac08705153 req-286fabc8-add1-4306-954e-6f5cb8e37c20 service nova] Creating event network-changed:3c15b40b-3126-4ab0-8e3c-b2ed2188737c for instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 on hv-cinder-84517 Jun 15 15:01:23.851686 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-e5620eb6-2596-4866-9602-deac08705153 req-286fabc8-add1-4306-954e-6f5cb8e37c20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Jun 15 15:01:23.852287 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 370/762] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:24.180849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:24.183157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:24.191667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:24.192131 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:24.192925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:24.193366 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:24.434102 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:24.443504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-452eb1b2-2502-4c72-977b-06386dae9be4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1673 microversion: 2.1 time: 0.266472 Jun 15 15:01:24.455377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 393/763] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:24 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1673 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:24.629035 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:24.630274 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:24.642766 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:24.643567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:24.644755 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:24.646064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:24.952187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:24.969549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-fc4d443e-209b-4297-b12a-fb8d729a6197 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1691 microversion: 2.1 time: 0.347209 Jun 15 15:01:24.979387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 371/764] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:24 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1691 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:25.461036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:25.461784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:25.469275 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:25.469736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:25.470575 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:25.471018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:25.702696 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:25.713940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-219f780b-019c-4288-be3d-739a9f480874 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1673 microversion: 2.1 time: 0.256702 Jun 15 15:01:25.715590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 394/765] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:25 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1673 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:25.987623 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:25.988243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:26.001710 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.002451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.003580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.004190 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.202305 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:26.217075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4e932638-b766-4791-9628-36bc65a7ef86 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1691 microversion: 2.1 time: 0.233300 Jun 15 15:01:26.217973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 372/766] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:25 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:26.734104 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:26.734775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:26.757545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.757996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:26.758810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:26.759252 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:27.035158 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-991989a9-b11c-4316-9ed5-300999f9256a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Action: 'create', calling method: .version_select at 0x7f693aa670d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-284020389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4r3vSACT8HLZ3p14vrMocoxLud9RaXF18jsTUvjQHKTc0C2JqMZENkwfG9iknrtecNWz22u07QBrNbPIqxjHwmCFK8e9QjpZI3RMUdu6zsF1O2j1ILKSt6QhoYT9OVag=="}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:27.055163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-991989a9-b11c-4316-9ed5-300999f9256a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for project 547883446fb944e4811768d29eb67583. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:27.059840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-991989a9-b11c-4316-9ed5-300999f9256a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for user 71f3bb1357f14481bd1850c1153bc253 and project 547883446fb944e4811768d29eb67583. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:27.151021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-991989a9-b11c-4316-9ed5-300999f9256a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.337302 Jun 15 15:01:27.152390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 373/767] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 15:01:26 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:27.243581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:27.243581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:27.250451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:27.251235 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:27.252274 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:27.252911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:27.429935 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:27.442405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3959a6bd-6245-42e0-902b-0a0362701457 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1673 microversion: 2.1 time: 0.711468 Jun 15 15:01:27.443432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 395/768] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:26 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1673 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:27.771152 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:27.779965 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d2329458-2940-4d9a-9ebf-e7b8a9053dc7 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1691 microversion: 2.1 time: 0.543092 Jun 15 15:01:27.781532 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 374/769] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:27 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1691 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:28.461044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:28.465251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:28.469156 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.469607 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.470408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.470843 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.604125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:28.621381 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c1dfc975-2fe6-4e19-9f73-89c8e8f75be0 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1606 microversion: 2.1 time: 0.164062 Jun 15 15:01:28.623096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 396/770] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:28 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1606 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:28.800740 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:28.801830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:28.814763 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.815585 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.816550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:28.817151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:28.957623 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:28.984614 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-76835bc2-b63a-4b04-a0a3-436fd0ea4023 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1623 microversion: 2.1 time: 0.190517 Jun 15 15:01:28.987957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 375/771] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:28 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1623 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:29.101553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-3bbe842d-ba40-4247-abf5-fd42b2d6566e req-de14be93-a524-4e81-9af3-d37b06266b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8490a7b-6956-4086-a14b-8d892496d608", "name": "network-vif-deleted", "tag": "36d09c08-3dcb-4a3b-9fc2-a993412d350d"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:29.114867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3bbe842d-ba40-4247-abf5-fd42b2d6566e req-de14be93-a524-4e81-9af3-d37b06266b4f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:29.115612 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3bbe842d-ba40-4247-abf5-fd42b2d6566e req-de14be93-a524-4e81-9af3-d37b06266b4f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:29.151211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-3bbe842d-ba40-4247-abf5-fd42b2d6566e req-de14be93-a524-4e81-9af3-d37b06266b4f service nova] Creating event network-vif-deleted:36d09c08-3dcb-4a3b-9fc2-a993412d350d for instance e8490a7b-6956-4086-a14b-8d892496d608 on hv-cinder-84517 Jun 15 15:01:29.157524 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-3bbe842d-ba40-4247-abf5-fd42b2d6566e req-de14be93-a524-4e81-9af3-d37b06266b4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189657 Jun 15 15:01:29.163765 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 397/772] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:29.640553 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:29.641597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:29.648653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:29.649598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:29.650698 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:29.651364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:29.731697 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:29.745204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f6ecd452-7790-4616-a6e8-fa8884a2c24d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1323 microversion: 2.1 time: 0.108880 Jun 15 15:01:29.746729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 376/773] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:29 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:30.004664 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:30.005490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:30.038646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:30.039122 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.039907 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:30.040347 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.117736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:30.118641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.119527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lazy-loading 'fault' on Instance uuid e8490a7b-6956-4086-a14b-8d892496d608 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:30.175224 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:30.194908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-75acfcd9-c445-4939-a6e4-fb5e7b639ba0 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 200 len: 1335 microversion: 2.1 time: 0.183281 Jun 15 15:01:30.194908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 398/774] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:29 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 1335 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:30.775191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:30.775677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:30.783424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:30.783880 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.784657 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:30.785095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.889181 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:30.889553 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:30.903281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lazy-loading 'fault' on Instance uuid 97c39abd-c1c7-443f-802e-a65f0e0888ec {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:30.978061 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:31.001275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-393b8605-8160-48f9-aa26-81a6f81f2859 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 200 len: 1328 microversion: 2.1 time: 0.230770 Jun 15 15:01:31.006547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 377/775] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:30 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 1328 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:31.049885 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1588fc67-7feb-495d-8012-997146257ca7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:31.053191 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1588fc67-7feb-495d-8012-997146257ca7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:31.069886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1588fc67-7feb-495d-8012-997146257ca7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.070395 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1588fc67-7feb-495d-8012-997146257ca7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.071200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1588fc67-7feb-495d-8012-997146257ca7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.075149 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1588fc67-7feb-495d-8012-997146257ca7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.128402 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1588fc67-7feb-495d-8012-997146257ca7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/ips" status: 200 len: 150 microversion: 2.1 time: 0.295192 Jun 15 15:01:31.134714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 399/776] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 15:01:30 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/ips => generated 150 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:31.184281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-162b98ac-9cfc-4e34-ae16-6962ee764124 req-82b4e94f-74b1-4cba-b27d-da11859b194d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c39abd-c1c7-443f-802e-a65f0e0888ec", "name": "network-vif-deleted", "tag": "d4d096f3-f841-4620-b51b-2526592f3ae0"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:31.201680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-162b98ac-9cfc-4e34-ae16-6962ee764124 req-82b4e94f-74b1-4cba-b27d-da11859b194d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.202131 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-162b98ac-9cfc-4e34-ae16-6962ee764124 req-82b4e94f-74b1-4cba-b27d-da11859b194d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.203399 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:31.204514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: e8490a7b-6956-4086-a14b-8d892496d608] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:31.218108 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.218714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.219585 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:31.220208 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:31.238643 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-162b98ac-9cfc-4e34-ae16-6962ee764124 req-82b4e94f-74b1-4cba-b27d-da11859b194d service nova] Creating event network-vif-deleted:d4d096f3-f841-4620-b51b-2526592f3ae0 for instance 97c39abd-c1c7-443f-802e-a65f0e0888ec on hv-cinder-84517 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] HTTP exception thrown: Instance e8490a7b-6956-4086-a14b-8d892496d608 could not be found. Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Request method failure captured: Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 HTTP/1.1 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL7VT0clRDZfL7x3_66jziJtK6z-0PVYCUkCP9eyGovsLr76J9px7zhftxgQBzjQ7S6QIC9D-zHaWdZ3t8aaxLb2qB8iCiCoSY7DAhftK1wKERI1XOpQ-PCuTdsQQzVyAMXaDHzg-8mIud9GRU3ikcX7K7Q77bzyUBLb8m2-5AoCi4 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:01:31.244507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: cbc9d5ce4a3241ea898f216543114fdf Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance e8490a7b-6956-4086-a14b-8d892496d608 could not be found. Jun 15 15:01:31.246272 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'e8490a7b-6956-4086-a14b-8d892496d608'} Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8490a7b-6956-4086-a14b-8d892496d608 could not be found. Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:31.247701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8490a7b-6956-4086-a14b-8d892496d608 could not be found. Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8490a7b-6956-4086-a14b-8d892496d608 could not be found. Jun 15 15:01:31.249190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:31.250577 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Returning 404 to user: Instance e8490a7b-6956-4086-a14b-8d892496d608 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:31.250577 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ca7e91bc-867b-4073-bc5e-0464e6a8b7c1 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608" status: 404 len: 111 microversion: 2.1 time: 0.047358 Jun 15 15:01:31.250759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-162b98ac-9cfc-4e34-ae16-6962ee764124 req-82b4e94f-74b1-4cba-b27d-da11859b194d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075597 Jun 15 15:01:31.250759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 378/778] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:31.250940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 400/778] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:31 2022] GET /compute/v2.1/servers/e8490a7b-6956-4086-a14b-8d892496d608 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:01:31.255468 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c315dd32-01b0-4349-ad15-b9fc275bf178 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '.version_select at 0x7f693aa67af0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:31.380058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c315dd32-01b0-4349-ad15-b9fc275bf178 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134871872" status: 202 len: 0 microversion: 2.1 time: 0.128255 Jun 15 15:01:31.381033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 379/779] 10.222.0.23 () {58 vars in 1220 bytes} [Wed Jun 15 15:01:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2134871872 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:01:32.024188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:32.025096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:32.038442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.038902 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:32.039883 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.040487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:32.055194 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] HTTP exception thrown: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Request method failure captured: Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec HTTP/1.1 Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL4plesDMsf4o_eg0lBkxHpqcDFAJAFvkpgOuPn4ZOXYdbwNbWMNIwQBdxlPdltSwKbsysUDuX1RW7GRzbNZg0QVAEpBQpXN5dbFPNALduGGvx67YW8UqzfmRWaSZ5MgI4-fskW5LeBzetqPeCVlAllV7dfgzZnXPxzn_0hTF3wvkM Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:01:32.057047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: df400aee39a3498d8a26d55180075ab6 Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:01:32.058490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '97c39abd-c1c7-443f-802e-a65f0e0888ec'} Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:32.059871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:01:32.061097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:32.062253 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Returning 404 to user: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:32.062253 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-637adf3f-0206-4c29-82fc-901ab5f4b275 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 404 len: 111 microversion: 2.1 time: 0.039018 Jun 15 15:01:32.062253 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 401/780] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:32 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:32.069373 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e50e8450-c76f-43e8-8fca-0952d451fa9c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '.version_select at 0x7f693aa6d310>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:32.140491 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e50e8450-c76f-43e8-8fca-0952d451fa9c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972416882" status: 202 len: 0 microversion: 2.1 time: 0.075645 Jun 15 15:01:32.141140 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 380/781] 10.222.0.23 () {58 vars in 1220 bytes} [Wed Jun 15 15:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972416882 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:01:32.933475 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-11095b9b-b5dd-4921-813b-cb213ede345c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f48ca69-4d32-483e-bcb2-5105786388d8"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:32.935190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-11095b9b-b5dd-4921-813b-cb213ede345c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:32.942360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11095b9b-b5dd-4921-813b-cb213ede345c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.942896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11095b9b-b5dd-4921-813b-cb213ede345c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:32.943760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11095b9b-b5dd-4921-813b-cb213ede345c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:32.944280 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11095b9b-b5dd-4921-813b-cb213ede345c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:33.257148 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5f17b938-2613-4f0b-b47f-d0b105c8b009 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'create', calling method: .version_select at 0x7f693aa8f4c0>, body: {"keypair": {"name": "tempest-keypair-471361055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5PpOE2lMtQ8kRIs7gRv9zDly03+2GbG5oBW+gHbgq1FMpQ0rCXISI572scQZFPJFq7VA85xjqT/cXHG3BWIuBgfZe69PffesNrqxtE1+7jXHOzk5mUncetc20JuMAD6g=="}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:33.271964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-5f17b938-2613-4f0b-b47f-d0b105c8b009 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:33.275761 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-5f17b938-2613-4f0b-b47f-d0b105c8b009 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for user df400aee39a3498d8a26d55180075ab6 and project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'key_pairs'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:33.350381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5f17b938-2613-4f0b-b47f-d0b105c8b009 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097630 Jun 15 15:01:33.351111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 381/782] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 15:01:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:33.929273 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-11095b9b-b5dd-4921-813b-cb213ede345c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.001169 Jun 15 15:01:33.929867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 402/783] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 15:01:32 2022] POST /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments => generated 194 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:34.953873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:34.955180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:34.961451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:34.961889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:34.962708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:34.963205 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:34.992708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:01:35.515662 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-de0040d9-1ca7-422e-983c-1e538e686961 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 204 len: 0 microversion: 2.1 time: 0.567528 Jun 15 15:01:35.516258 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 382/784] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:34 2022] DELETE /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:01:35.525260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:35.526502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:35.534259 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:35.534726 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:35.535518 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:35.535957 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:35.695530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:35.704124 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-09f846a1-755c-4729-b784-da400bc7ea00 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1509 microversion: 2.1 time: 0.183560 Jun 15 15:01:35.704698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 403/785] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:35 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:36.316157 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-230577302", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05bfcb97-d977-4a20-a34c-9858d88e885b"}], "security_groups": [{"name": "tempest-securitygroup--308684533"}], "key_name": "tempest-keypair-471361055", "user_data": "}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:36.423856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] validate_networks() for [('05bfcb97-d977-4a20-a34c-9858d88e885b', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:01:36.723258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:36.723869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:36.730391 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.731519 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.732286 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.732730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.749678 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:36.948842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:36.957433 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-80a61679-fd5a-4359-8be1-bace0b11bb92 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1509 microversion: 2.1 time: 0.238524 Jun 15 15:01:36.962449 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 404/786] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:36 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:36.977089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:01:36.977512 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:01:36.977985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:01:36.978450 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:01:36.978861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:01:36.989120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.989392 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:36.990315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:36.990760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.009006 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:37.013725 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Getting quotas for user df400aee39a3498d8a26d55180075ab6 and project 3ae6c02cace9481d9b87e8f9d61323c3. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:37.024886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:01:37.027926 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:01:37.191498 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5eaa1434-20e9-4e9e-88a2-851f76cd8adb tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.880022 Jun 15 15:01:37.192265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 383/787] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:01:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:01:37.203439 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-50292468-57bf-43cd-8792-dd3d45b5d0aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:37.204437 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-50292468-57bf-43cd-8792-dd3d45b5d0aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:37.260851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-50292468-57bf-43cd-8792-dd3d45b5d0aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:37.280471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-50292468-57bf-43cd-8792-dd3d45b5d0aa tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1236 microversion: 2.1 time: 0.070873 Jun 15 15:01:37.280471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 405/788] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:37 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:37.979731 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:37.980418 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:37.982968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:37.987854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.988310 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:37.989080 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:37.989529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:38.087697 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:38.112815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d2468e07-7961-4b05-96ca-c5e725f674c6 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1467 microversion: 2.1 time: 0.137595 Jun 15 15:01:38.114082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 384/789] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:37 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1467 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:38.167200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-15d42b5f-27b7-4880-b67c-5acecaa13b42 req-87d09af3-9a96-473b-9315-1fc17da80627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff1fa86-018b-467f-a6cf-63db9cbba893", "name": "network-vif-deleted", "tag": "f1c6c166-89bd-466b-9b18-5bb2233786d8"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:38.176732 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-15d42b5f-27b7-4880-b67c-5acecaa13b42 req-87d09af3-9a96-473b-9315-1fc17da80627 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:38.177199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-15d42b5f-27b7-4880-b67c-5acecaa13b42 req-87d09af3-9a96-473b-9315-1fc17da80627 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:38.189290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-15d42b5f-27b7-4880-b67c-5acecaa13b42 req-87d09af3-9a96-473b-9315-1fc17da80627 service nova] Creating event network-vif-deleted:f1c6c166-89bd-466b-9b18-5bb2233786d8 for instance aff1fa86-018b-467f-a6cf-63db9cbba893 on hv-cinder-84517 Jun 15 15:01:38.201354 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-15d42b5f-27b7-4880-b67c-5acecaa13b42 req-87d09af3-9a96-473b-9315-1fc17da80627 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031303 Jun 15 15:01:38.201354 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 406/790] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:38.287714 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1d911927-e23b-4238-9685-f8600c58d564 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:38.288894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1d911927-e23b-4238-9685-f8600c58d564 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:38.343050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d911927-e23b-4238-9685-f8600c58d564 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:38.350513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1d911927-e23b-4238-9685-f8600c58d564 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1236 microversion: 2.1 time: 0.067165 Jun 15 15:01:38.351078 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 385/791] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:38 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:39.130503 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:39.131235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:39.138536 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:39.139001 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:39.139785 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:39.140223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:39.173301 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:39.178656 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:39.178656 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lazy-loading 'fault' on Instance uuid aff1fa86-018b-467f-a6cf-63db9cbba893 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:39.217864 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:39.226769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-cb2725f3-07d8-40b5-a6f4-0579ac665079 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 200 len: 1312 microversion: 2.1 time: 0.100827 Jun 15 15:01:39.227680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 407/792] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:39 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:39.368023 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:39.368716 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:39.376586 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:39.378270 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:39.379624 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:39.380157 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:39.449651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:39.457286 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b4097962-31cf-41bb-8fdf-1f728ae14651 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1288 microversion: 2.1 time: 0.093698 Jun 15 15:01:39.457852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 386/793] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:39 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:40.244684 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:40.245352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: aff1fa86-018b-467f-a6cf-63db9cbba893] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:40.250249 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:40.254006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.254668 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.255589 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.255893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.290953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] HTTP exception thrown: Instance aff1fa86-018b-467f-a6cf-63db9cbba893 could not be found. Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Request method failure captured: Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 HTTP/1.1 Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL7VT0clRDZfL7x3_66jziJtK6z-0PVYCUkCP9eyGovsLr76J9px7zhftxgQBzjQ7S6QIC9D-zHaWdZ3t8aaxLb2qB8iCiCoSY7DAhftK1wKERI1XOpQ-PCuTdsQQzVyAMXaDHzg-8mIud9GRU3ikcX7K7Q77bzyUBLb8m2-5AoCi4 Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:01:40.292738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: cbc9d5ce4a3241ea898f216543114fdf Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance aff1fa86-018b-467f-a6cf-63db9cbba893 could not be found. Jun 15 15:01:40.294100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'aff1fa86-018b-467f-a6cf-63db9cbba893'} Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff1fa86-018b-467f-a6cf-63db9cbba893 could not be found. Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:40.295087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff1fa86-018b-467f-a6cf-63db9cbba893 could not be found. Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff1fa86-018b-467f-a6cf-63db9cbba893 could not be found. Jun 15 15:01:40.296955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:40.298005 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Returning 404 to user: Instance aff1fa86-018b-467f-a6cf-63db9cbba893 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:40.298005 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1d53f8f8-7240-4c72-b730-cc1c03b942f2 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893" status: 404 len: 111 microversion: 2.1 time: 0.053905 Jun 15 15:01:40.298875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 408/794] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:40 2022] GET /compute/v2.1/servers/aff1fa86-018b-467f-a6cf-63db9cbba893 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:40.304198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:40.304691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:40.311742 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.322859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.332868 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.333694 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.365220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:01:40.475166 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:40.475808 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:40.483365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.484972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.485761 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.486233 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.560896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:40.568510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d8dfb4aa-4d32-40fe-87e0-72bbc5917795 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1294 microversion: 2.1 time: 0.097503 Jun 15 15:01:40.573599 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 409/795] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:40 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:40.913709 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-43846002-cbef-417d-8c1b-0f798b7cce6e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 204 len: 0 microversion: 2.1 time: 0.613287 Jun 15 15:01:40.914410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 387/796] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:40 2022] DELETE /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:01:40.940200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:40.940766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:40.947133 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.947589 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:40.948354 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:40.948850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:41.173199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:41.181673 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5ca9af41-ead9-4102-a548-c3c399a0dfe9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.245345 Jun 15 15:01:41.182418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 410/797] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:40 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:41.587484 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:41.588180 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:41.595642 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:41.596100 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:41.597232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:41.597616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:41.730586 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:41.738102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-916655c7-8e89-420d-b687-1cfcbc607370 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.155299 Jun 15 15:01:41.738686 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 388/798] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:41 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:42.199769 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:42.200511 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:42.207479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:42.208012 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:42.208908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:42.209369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:42.344189 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:42.352551 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-dc13ff82-49bd-4c0b-81d0-e21ada0a466a tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.157325 Jun 15 15:01:42.353123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 411/799] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:42 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:42.755444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:42.756163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:42.762906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:42.763396 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:42.764171 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:42.764728 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:42.895108 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:42.902856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a5d3758a-b5ee-4d2d-a074-d9ca4e64a1a8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.151243 Jun 15 15:01:42.903461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 389/800] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:42 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:43.369215 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:43.369751 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:43.376905 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:43.377372 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:43.378152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:43.378630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:43.515069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:43.522896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8128cddb-edfc-4a49-8a11-f52fa9a71a2e tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.157680 Jun 15 15:01:43.523484 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 412/801] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:43 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:43.920961 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:43.921548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:43.928746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:43.929194 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:43.930217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:43.930633 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:43.936551 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:44.197836 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:44.206924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f34b5264-c8b8-416c-97a7-83af6596cf49 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.290370 Jun 15 15:01:44.207497 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 390/802] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:43 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:44.540723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:44.542723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:44.557409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:44.558634 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:44.564152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:44.565025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:44.863923 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:44.871571 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-84e0dd37-b957-42a1-903d-a6f788aac27b tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1523 microversion: 2.1 time: 0.334640 Jun 15 15:01:44.872142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 413/803] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:44 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1523 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:45.030389 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-caf739bc-bb31-4f0b-b875-18bb6f1e1b69 req-c4ea6836-cf5f-4d21-bdf2-739da3a10158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98936448-9213-42cd-9aae-cd8fd5cd756c", "tag": "df81f8c2-6abf-4f53-9203-841bf57a88f9"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:45.040663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-caf739bc-bb31-4f0b-b875-18bb6f1e1b69 req-c4ea6836-cf5f-4d21-bdf2-739da3a10158 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:45.041115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-caf739bc-bb31-4f0b-b875-18bb6f1e1b69 req-c4ea6836-cf5f-4d21-bdf2-739da3a10158 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:45.072248 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-caf739bc-bb31-4f0b-b875-18bb6f1e1b69 req-c4ea6836-cf5f-4d21-bdf2-739da3a10158 service nova] Creating event network-changed:df81f8c2-6abf-4f53-9203-841bf57a88f9 for instance 98936448-9213-42cd-9aae-cd8fd5cd756c on hv-cinder-84517 Jun 15 15:01:45.077767 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-caf739bc-bb31-4f0b-b875-18bb6f1e1b69 req-c4ea6836-cf5f-4d21-bdf2-739da3a10158 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051417 Jun 15 15:01:45.078851 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 391/804] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:45.225363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:45.234669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:45.253750 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:45.254231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:45.255027 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:45.255646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:45.719194 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:45.734984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-bb7d174d-441b-443b-b70d-81cacee1e343 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.514037 Jun 15 15:01:45.736108 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 414/805] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:45 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:45.889524 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:45.890254 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:45.896525 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:45.896980 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:45.897744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:45.898197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:45.981612 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:45.990102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f452e96a-8078-43ef-879d-cbb6a4c6412f tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1481 microversion: 2.1 time: 0.105450 Jun 15 15:01:45.990831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 392/806] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:45 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1481 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:46.753273 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:46.753648 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:46.760383 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:46.760839 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:46.761661 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:46.762150 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:46.868951 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f48ca69-4d32-483e-bcb2-5105786388d8"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:46.870028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:46.876738 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:46.877251 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:46.878266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:46.878707 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:46.921039 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:46.928596 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-180e6642-b3d5-42b4-875c-6f874e7fc9ed tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.179819 Jun 15 15:01:46.929146 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 415/807] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:46 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:46.960172 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Invalid volume: volume 3f48ca69-4d32-483e-bcb2-5105786388d8 is already attached to instances: 213535cc-ae46-43b2-ad12-f49fc89e13b2 Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: POST /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments HTTP/1.1 Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 74 Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:01:46.961928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {"volumeAttachment": {"volumeId": "3f48ca69-4d32-483e-bcb2-5105786388d8"}} Jun 15 15:01:46.970265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Invalid volume: volume 3f48ca69-4d32-483e-bcb2-5105786388d8 is already attached to instances: 213535cc-ae46-43b2-ad12-f49fc89e13b2 Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'server_id': '213535cc-ae46-43b2-ad12-f49fc89e13b2', 'body': {'volumeAttachment': {'volumeId': '3f48ca69-4d32-483e-bcb2-5105786388d8'}}} Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3f48ca69-4d32-483e-bcb2-5105786388d8 is already attached to instances: 213535cc-ae46-43b2-ad12-f49fc89e13b2 Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:01:46.971087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3f48ca69-4d32-483e-bcb2-5105786388d8 is already attached to instances: 213535cc-ae46-43b2-ad12-f49fc89e13b2 Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:46.972492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3f48ca69-4d32-483e-bcb2-5105786388d8 is already attached to instances: 213535cc-ae46-43b2-ad12-f49fc89e13b2 Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 400 to user: Invalid volume: volume 3f48ca69-4d32-483e-bcb2-5105786388d8 is already attached to instances: 213535cc-ae46-43b2-ad12-f49fc89e13b2 {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cff0394f-678b-42cf-8903-415bc23751f4 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099120 Jun 15 15:01:46.973651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 393/808] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 15:01:46 2022] POST /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:01:47.010865 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:47.012140 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:47.018099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.018583 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.019352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.019788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.031965 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:47.032495 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:47.034642 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:47.039630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.040083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.040995 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.041440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.052691 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.053139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.053590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lazy-loading 'fault' on Instance uuid 6fbdc341-c8d4-435d-a52c-9e4387a70cfc {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:47.099157 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc9d5ce4a3241ea898f216543114fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a03d17e6f54c66bb4ca7571246be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:47.107252 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-bc475859-489c-4350-b8fe-6cf5efe9abd9 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 200 len: 1312 microversion: 2.1 time: 0.100128 Jun 15 15:01:47.107817 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 416/809] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:47 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:47.114247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-1e223792-eac7-4fd2-881f-76d3d64cf48e req-2dd72cbd-4e15-4c58-b68b-9a19241322f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbdc341-c8d4-435d-a52c-9e4387a70cfc", "name": "network-vif-deleted", "tag": "8ec702c0-ce7f-483c-b9dc-e27046ef0c8d"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:47.120821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-1e223792-eac7-4fd2-881f-76d3d64cf48e req-2dd72cbd-4e15-4c58-b68b-9a19241322f5 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.121366 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-1e223792-eac7-4fd2-881f-76d3d64cf48e req-2dd72cbd-4e15-4c58-b68b-9a19241322f5 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.130093 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'services' on Instance uuid 213535cc-ae46-43b2-ad12-f49fc89e13b2 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:47.132779 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-1e223792-eac7-4fd2-881f-76d3d64cf48e req-2dd72cbd-4e15-4c58-b68b-9a19241322f5 service nova] Creating event network-vif-deleted:8ec702c0-ce7f-483c-b9dc-e27046ef0c8d for instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc on hv-cinder-84517 Jun 15 15:01:47.137711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-1e223792-eac7-4fd2-881f-76d3d64cf48e req-2dd72cbd-4e15-4c58-b68b-9a19241322f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028790 Jun 15 15:01:47.138329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 417/810] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:47.324728 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f85da598-b422-433c-8abe-2f2e1e667547 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments/3f48ca69-4d32-483e-bcb2-5105786388d8" status: 202 len: 0 microversion: 2.1 time: 0.296545 Jun 15 15:01:47.325312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 394/811] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:01:47 2022] DELETE /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments/3f48ca69-4d32-483e-bcb2-5105786388d8 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:01:47.330703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:47.334996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-07a6ec55-a6cc-473d-90b1-5f1cf4572378 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:47.336025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-07a6ec55-a6cc-473d-90b1-5f1cf4572378 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:47.343506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07a6ec55-a6cc-473d-90b1-5f1cf4572378 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.343956 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07a6ec55-a6cc-473d-90b1-5f1cf4572378 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.344718 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07a6ec55-a6cc-473d-90b1-5f1cf4572378 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.345151 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07a6ec55-a6cc-473d-90b1-5f1cf4572378 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.374672 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-07a6ec55-a6cc-473d-90b1-5f1cf4572378 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Jun 15 15:01:47.375218 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 418/812] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:47 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:47.945292 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:47.945986 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:47.953953 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.954439 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:47.955194 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:47.955626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:48.091327 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:48.099303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3f79486d-13a3-4698-88fa-d566628ff13d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.158168 Jun 15 15:01:48.099894 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 395/813] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:47 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:48.125187 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:48.125797 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] [instance: 6fbdc341-c8d4-435d-a52c-9e4387a70cfc] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:48.132587 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:48.133042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:48.133809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:48.134283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:48.148695 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] HTTP exception thrown: Instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc could not be found. Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Request method failure captured: Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc HTTP/1.1 Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL7VT0clRDZfL7x3_66jziJtK6z-0PVYCUkCP9eyGovsLr76J9px7zhftxgQBzjQ7S6QIC9D-zHaWdZ3t8aaxLb2qB8iCiCoSY7DAhftK1wKERI1XOpQ-PCuTdsQQzVyAMXaDHzg-8mIud9GRU3ikcX7K7Q77bzyUBLb8m2-5AoCi4 Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:01:48.150361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65a03d17e6f54c66bb4ca7571246be87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 65a03d17e6f54c66bb4ca7571246be87 Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2039594011 Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: cbc9d5ce4a3241ea898f216543114fdf Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2039594011-project Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc could not be found. Jun 15 15:01:48.152998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '6fbdc341-c8d4-435d-a52c-9e4387a70cfc'} Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc could not be found. Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:48.153867 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc could not be found. Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc could not be found. Jun 15 15:01:48.155494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:48.156737 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] Returning 404 to user: Instance 6fbdc341-c8d4-435d-a52c-9e4387a70cfc could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:48.156737 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8d530efd-5aa1-4d15-a616-041e13679300 tempest-ServerRescueNegativeTestJSON-2039594011 tempest-ServerRescueNegativeTestJSON-2039594011-project] 10.222.0.23 "GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc" status: 404 len: 111 microversion: 2.1 time: 0.030803 Jun 15 15:01:48.156737 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 419/814] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:48 2022] GET /compute/v2.1/servers/6fbdc341-c8d4-435d-a52c-9e4387a70cfc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:01:48.386888 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-28e4650e-7e11-41cc-b4d9-ff186fae0ef6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:48.387801 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-28e4650e-7e11-41cc-b4d9-ff186fae0ef6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:48.389756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=16 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:48.394665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28e4650e-7e11-41cc-b4d9-ff186fae0ef6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:48.395113 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28e4650e-7e11-41cc-b4d9-ff186fae0ef6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:48.395867 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28e4650e-7e11-41cc-b4d9-ff186fae0ef6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:48.397295 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28e4650e-7e11-41cc-b4d9-ff186fae0ef6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:48.427069 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-28e4650e-7e11-41cc-b4d9-ff186fae0ef6 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Jun 15 15:01:48.427615 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 396/815] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:48 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:49.116285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:49.117153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:49.123976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.124528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.125297 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.125849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.264183 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:49.272701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-198c361d-2ee1-4902-a9bf-99839c1af754 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.160322 Jun 15 15:01:49.273281 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 420/816] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:49 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:49.438510 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-bf93b259-3dbe-4fed-ad6f-173337b5649d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:49.439487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-bf93b259-3dbe-4fed-ad6f-173337b5649d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:49.446223 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bf93b259-3dbe-4fed-ad6f-173337b5649d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.446679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bf93b259-3dbe-4fed-ad6f-173337b5649d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.447437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bf93b259-3dbe-4fed-ad6f-173337b5649d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.447876 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-bf93b259-3dbe-4fed-ad6f-173337b5649d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.477238 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-bf93b259-3dbe-4fed-ad6f-173337b5649d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043180 Jun 15 15:01:49.477785 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 397/817] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:01:49 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:01:49.534545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:49.535049 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:49.541317 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.544926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.544926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:49.544926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:49.573888 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:01:50.096791 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ceab1c5c-b6ac-48e0-bb50-b56ccba4d001 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 204 len: 0 microversion: 2.1 time: 0.565633 Jun 15 15:01:50.097564 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 421/818] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:01:49 2022] DELETE /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:01:50.105742 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:50.106397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:50.112618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:50.113135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:50.113963 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:50.114595 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:50.258185 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:50.270935 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-79631526-2c0e-482f-bace-d55524b2c452 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1682 microversion: 2.1 time: 0.169043 Jun 15 15:01:50.272072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 398/819] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:50 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:50.296290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:50.297076 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:50.305662 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:50.306387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:50.307334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:50.308997 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:50.324915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:50.444637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:50.455567 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e87bc0ef-0ff1-4e7b-bdf2-dc3b528e0b40 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.168672 Jun 15 15:01:50.456512 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 422/820] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:50 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:51.168117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-10742812", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-284020389", "security_groups": [{"name": "tempest-secgroup-smoke-2103269246"}], "block_device_mapping_v2": [{"uuid": "eb44597f-5d06-440d-921e-ad2262941609", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5d513a22-cd88-4063-a54c-439ca917eee0"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:51.289316 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] validate_networks() for [('5d513a22-cd88-4063-a54c-439ca917eee0', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:01:51.302475 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:51.304162 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:51.319546 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:51.320730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:51.321838 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:51.322537 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:51.609437 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:51.617073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-82736699-1997-4c0f-bfa8-f0a79b938923 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1682 microversion: 2.1 time: 0.319407 Jun 15 15:01:51.617646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 423/821] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:51 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1682 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:51.622768 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:51.623424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:51.634546 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:51.635135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:51.636475 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:51.637004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:51.960083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:51.969196 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6f06f9f3-ae0f-45f6-b47a-46eb6399f193 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.350225 Jun 15 15:01:51.969934 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 424/822] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:51 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:51.996861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:01:51.997279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:01:51.997884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:01:51.998339 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:01:51.998926 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:01:52.008700 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.009149 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.009954 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.010496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.028901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for project 547883446fb944e4811768d29eb67583. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:52.032863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for user 71f3bb1357f14481bd1850c1153bc253 and project 547883446fb944e4811768d29eb67583. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:52.097094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:01:52.099217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb44597f-5d06-440d-921e-ad2262941609',volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:01:52.634284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:52.636074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:52.643089 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.643575 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.644356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.644981 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.693182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4f020743-99ec-4e22-8113-d9dcc5325989 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.529397 Jun 15 15:01:52.694274 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 399/823] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:01:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:01:52.704703 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e7dce0b0-cc03-4bb8-bc43-a69f2b1f2327 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:52.705854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e7dce0b0-cc03-4bb8-bc43-a69f2b1f2327 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:52.800101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e7dce0b0-cc03-4bb8-bc43-a69f2b1f2327 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:52.809741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e7dce0b0-cc03-4bb8-bc43-a69f2b1f2327 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1092 microversion: 2.1 time: 0.108808 Jun 15 15:01:52.820172 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 400/824] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:52 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1092 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:52.844739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:52.852903 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-21613042-acdf-48e5-afa1-946b273b6e7a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1682 microversion: 2.1 time: 0.222497 Jun 15 15:01:52.853692 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 425/825] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:52 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:52.986703 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:52.987320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:52.996023 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.996635 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:52.997531 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:52.998082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.226553 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:53.238461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a662a56d-b666-42a4-a45e-6aa2d8f4970b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.255701 Jun 15 15:01:53.240988 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 401/826] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:52 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:53.334592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-15732e88-2605-4834-b459-54a42098721a req-3d032fe6-fa83-4f51-8a9f-ad426f590603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213535cc-ae46-43b2-ad12-f49fc89e13b2", "name": "network-vif-deleted", "tag": "baf8202d-6ebd-4dab-ba4d-7b7adc881bc9"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:53.347029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-15732e88-2605-4834-b459-54a42098721a req-3d032fe6-fa83-4f51-8a9f-ad426f590603 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:53.368550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-15732e88-2605-4834-b459-54a42098721a req-3d032fe6-fa83-4f51-8a9f-ad426f590603 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.368550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-15732e88-2605-4834-b459-54a42098721a req-3d032fe6-fa83-4f51-8a9f-ad426f590603 service nova] Creating event network-vif-deleted:baf8202d-6ebd-4dab-ba4d-7b7adc881bc9 for instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 on hv-cinder-84517 Jun 15 15:01:53.368550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-15732e88-2605-4834-b459-54a42098721a req-3d032fe6-fa83-4f51-8a9f-ad426f590603 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036439 Jun 15 15:01:53.371237 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 426/827] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:53.406036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-f4f452b6-2a2d-4503-bba8-a6508c694b4e req-4983f36d-e76e-4ed5-a798-bb84fd2df9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98936448-9213-42cd-9aae-cd8fd5cd756c", "name": "network-vif-plugged", "status": "completed", "tag": "df81f8c2-6abf-4f53-9203-841bf57a88f9"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:53.414450 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f4f452b6-2a2d-4503-bba8-a6508c694b4e req-4983f36d-e76e-4ed5-a798-bb84fd2df9de service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:53.414911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f4f452b6-2a2d-4503-bba8-a6508c694b4e req-4983f36d-e76e-4ed5-a798-bb84fd2df9de service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.431690 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-f4f452b6-2a2d-4503-bba8-a6508c694b4e req-4983f36d-e76e-4ed5-a798-bb84fd2df9de service nova] Creating event network-vif-plugged:df81f8c2-6abf-4f53-9203-841bf57a88f9 for instance 98936448-9213-42cd-9aae-cd8fd5cd756c on hv-cinder-84517 Jun 15 15:01:53.448895 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-f4f452b6-2a2d-4503-bba8-a6508c694b4e req-4983f36d-e76e-4ed5-a798-bb84fd2df9de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035788 Jun 15 15:01:53.448895 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 402/828] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:53.828448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8a0833ba-eade-42fa-a693-18376583719d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.829897 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8a0833ba-eade-42fa-a693-18376583719d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:53.873427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:53.874769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:53.883076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:53.883770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.885225 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:53.885823 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.920771 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8a0833ba-eade-42fa-a693-18376583719d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:53.928566 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8a0833ba-eade-42fa-a693-18376583719d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1092 microversion: 2.1 time: 0.105622 Jun 15 15:01:53.938743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 427/829] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1092 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:53.940122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:53.940856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:53.941424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'fault' on Instance uuid 213535cc-ae46-43b2-ad12-f49fc89e13b2 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:53.999295 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:54.007070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1d0cd238-4298-4006-a33c-c81ce1f0c92a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1331 microversion: 2.1 time: 0.139600 Jun 15 15:01:54.008005 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 403/830] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:53 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1331 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:54.258217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:54.258846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:54.267313 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:54.267778 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:54.268780 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:54.269210 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:54.456807 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:54.465414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2185b4d9-4da3-4009-90ef-51ba57ea1340 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.210980 Jun 15 15:01:54.466268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 428/831] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:54 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:54.944684 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:54.945301 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:54.952548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:54.953006 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:54.953783 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:54.954413 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.023881 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:55.031313 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2b7f9cae-c39d-43c5-ae6a-d51e6093b31c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1142 microversion: 2.1 time: 0.090532 Jun 15 15:01:55.031876 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 404/832] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:54 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1142 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:55.038936 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:55.039685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:55.046869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:55.047317 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.048082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:55.048517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.081660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:55.082105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.082582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'fault' on Instance uuid 213535cc-ae46-43b2-ad12-f49fc89e13b2 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:01:55.122613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:55.130155 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ddfa6c9e-247a-4a6c-975c-69c7eaf70714 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 200 len: 1331 microversion: 2.1 time: 0.095267 Jun 15 15:01:55.130736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 429/833] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:55 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:55.458382 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7419fdaa-a577-496f-8861-6c59c7d3c925 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Action: 'create', calling method: .version_select at 0x7f693aa9fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-174401351"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:55.484650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:55.485269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:55.491478 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:55.491926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.492685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:55.493117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:55.641509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:55.649213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-07682dbb-545a-4198-8ac2-caa5aceaea8c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1361 microversion: 2.1 time: 0.168473 Jun 15 15:01:55.649783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 430/834] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:55 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:56.048310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:56.048968 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:56.055866 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.056315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.057680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.058119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.119209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:56.127873 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-614599c6-4b36-440b-b129-07bbb229f35b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1134 microversion: 2.1 time: 0.083496 Jun 15 15:01:56.128431 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 431/835] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:56 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1134 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:56.146410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:56.147012 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:56.152809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.153258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.154009 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.154475 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.167764 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 HTTP/1.1 Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:01:56.169410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:01:56.170978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '213535cc-ae46-43b2-ad12-f49fc89e13b2'} Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:01:56.171842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:01:56.173246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:01:56.174545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:01:56.174545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e810c1ab-fa03-4cf4-83f0-20d07b781b7c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 404 len: 111 microversion: 2.1 time: 0.027935 Jun 15 15:01:56.174545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 432/836] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:56 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:01:56.179074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a7394935-7854-407a-9f9b-664c7c840c75 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '.version_select at 0x7f693a1cddc0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:56.382910 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a7394935-7854-407a-9f9b-664c7c840c75 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034900751" status: 202 len: 0 microversion: 2.1 time: 0.207219 Jun 15 15:01:56.391603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 433/837] 10.222.0.23 () {58 vars in 1220 bytes} [Wed Jun 15 15:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034900751 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:01:56.638689 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7419fdaa-a577-496f-8861-6c59c7d3c925 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.297551 Jun 15 15:01:56.639673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 405/838] 10.222.0.23 () {60 vars in 1154 bytes} [Wed Jun 15 15:01:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1299 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 15:01:56.650155 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-200b3b54-9fd2-4f08-b9d0-7db8227d9992 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a276e50>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:56.666337 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:56.667770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:56.677399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.677962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.678996 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.679436 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.705298 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-200b3b54-9fd2-4f08-b9d0-7db8227d9992 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691" status: 200 len: 344 microversion: 2.1 time: 0.058959 Jun 15 15:01:56.711082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 434/839] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:01:56 2022] GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:56.854582 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:56.862332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e242c1ab-5cb3-4862-89a2-a1f6130475b4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1548 microversion: 2.1 time: 0.200063 Jun 15 15:01:56.862900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 406/840] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:56 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:56.879073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-034f5be9-3065-421e-80ab-292d54fea958 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:56.879577 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-034f5be9-3065-421e-80ab-292d54fea958 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:56.887035 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-034f5be9-3065-421e-80ab-292d54fea958 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.887536 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-034f5be9-3065-421e-80ab-292d54fea958 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.888516 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-034f5be9-3065-421e-80ab-292d54fea958 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:56.888962 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-034f5be9-3065-421e-80ab-292d54fea958 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:56.972184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-034f5be9-3065-421e-80ab-292d54fea958 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097036 Jun 15 15:01:56.972907 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 435/841] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 15:01:56 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:57.146153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:57.146712 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:57.156219 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:57.156671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:57.161785 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:57.161785 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:57.247615 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:57.257552 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-88ef66cd-f5f9-4817-8434-fd4e252babf9 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1190 microversion: 2.1 time: 0.116341 Jun 15 15:01:57.258427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 407/842] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:57 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:57.554211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5f6a7f6a-9aeb-4584-aac8-01855660b73c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: .version_select at 0x7f693a276e50>, body: {"keypair": {"name": "tempest-keypair-970729002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHnF9lsqRjzOzLcNdI0EvcCdTXnmiy8q/7FHB+KXaLr6jaQ9CjjudkqfbwNOGxqGP+JeCrhLNjxJ0qIH+f7crhOKQjdd1FiGVGKXWlyuOYLR5qH61YEln+Qb4mi1WdZHA=="}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:57.568749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-5f6a7f6a-9aeb-4584-aac8-01855660b73c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:01:57.573129 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-5f6a7f6a-9aeb-4584-aac8-01855660b73c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:01:57.725216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6d1089bc-596a-40ae-b9fd-ad0226e3b0d4 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693aa73280>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:57.749150 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5f6a7f6a-9aeb-4584-aac8-01855660b73c tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199268 Jun 15 15:01:57.749833 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 436/843] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 15:01:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:57.803901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6d1089bc-596a-40ae-b9fd-ad0226e3b0d4 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691" status: 200 len: 345 microversion: 2.1 time: 0.083772 Jun 15 15:01:57.804605 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 408/844] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:01:57 2022] GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:01:57.819459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-85e6a989-3ee3-46f8-be8f-b5cc29142b9f tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Action: 'create', calling method: .version_select at 0x7f693a3d03a0>, body: {"snapshot": {"volume_id": "2a56d576-ea98-491c-8d44-d5ae8e979691", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2110003995"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:58.275783 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:58.276548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:58.283412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:58.283779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:58.284565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:58.285108 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:58.411103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:58.419983 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-973ef843-c01f-4942-9303-4f545df502f6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1208 microversion: 2.1 time: 0.148583 Jun 15 15:01:58.420671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 409/845] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:58 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1208 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:01:58.472528 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-85e6a989-3ee3-46f8-be8f-b5cc29142b9f tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.659986 Jun 15 15:01:58.473417 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 437/846] 10.222.0.23 () {60 vars in 1161 bytes} [Wed Jun 15 15:01:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:58.483400 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9cdba6a5-b911-477b-b8d7-c21c875a02ba tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693aa73670>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:58.522075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9cdba6a5-b911-477b-b8d7-c21c875a02ba tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 200 len: 287 microversion: 2.1 time: 0.042778 Jun 15 15:01:58.522688 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 410/847] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:01:58 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:58.533608 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-22f33887-be40-47ff-be08-586506140afe tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a289ee0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:58.567538 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-22f33887-be40-47ff-be08-586506140afe tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037719 Jun 15 15:01:58.568086 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 438/848] 10.222.0.23 () {58 vars in 1139 bytes} [Wed Jun 15 15:01:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:58.579382 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a0ab10ae-4f15-4e0a-9cac-43b34d76bb88 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693aa67310>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:58.614064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a0ab10ae-4f15-4e0a-9cac-43b34d76bb88 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 200 len: 287 microversion: 2.1 time: 0.038578 Jun 15 15:01:58.614701 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 411/849] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:01:58 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:58.685080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-05454f55-c45e-491f-a20d-004c91a64872 req-4757a93c-589d-4d30-8da7-c50c26f8d1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98936448-9213-42cd-9aae-cd8fd5cd756c", "tag": "df81f8c2-6abf-4f53-9203-841bf57a88f9"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:01:58.696714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-05454f55-c45e-491f-a20d-004c91a64872 req-4757a93c-589d-4d30-8da7-c50c26f8d1b9 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:58.698147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-05454f55-c45e-491f-a20d-004c91a64872 req-4757a93c-589d-4d30-8da7-c50c26f8d1b9 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:58.719984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-05454f55-c45e-491f-a20d-004c91a64872 req-4757a93c-589d-4d30-8da7-c50c26f8d1b9 service nova] Creating event network-changed:df81f8c2-6abf-4f53-9203-841bf57a88f9 for instance 98936448-9213-42cd-9aae-cd8fd5cd756c on hv-cinder-84517 Jun 15 15:01:58.726145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-05454f55-c45e-491f-a20d-004c91a64872 req-4757a93c-589d-4d30-8da7-c50c26f8d1b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046049 Jun 15 15:01:58.727336 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 439/850] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:01:59.438023 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:59.438670 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:01:59.445566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:59.446020 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:59.446938 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:01:59.447460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:01:59.531166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:01:59.533831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:01:59.544088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-95a65438-a478-4c58-91e6-0950b14217c1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1208 microversion: 2.1 time: 0.110363 Jun 15 15:01:59.545994 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 412/851] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:01:59 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1208 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:01:59.637113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-53bb4a06-033c-4c5b-94a9-65146e1879c5 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a3d0280>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:01:59.678036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-53bb4a06-033c-4c5b-94a9-65146e1879c5 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 200 len: 287 microversion: 2.1 time: 0.052875 Jun 15 15:01:59.678630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 440/852] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:01:59 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:00.563952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:00.564665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:00.572193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:00.575596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:00.575596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:00.575596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:00.690602 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-22168297-61ba-45db-8016-643994201d89 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a3238b0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:00.729436 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-22168297-61ba-45db-8016-643994201d89 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 200 len: 287 microversion: 2.1 time: 0.043293 Jun 15 15:02:00.734201 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 441/853] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:02:00 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:02:00.747346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:00.757288 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3a9de3d6-0af1-4bbb-8443-65deb20f2aad tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1276 microversion: 2.1 time: 0.199144 Jun 15 15:02:00.758134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 413/854] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:00 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:01.291657 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-245711775", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f4844db-ed6c-4bba-97af-aa7e459b2e26"}], "security_groups": [{"name": "tempest-securitygroup--623262783"}], "key_name": "tempest-keypair-970729002", "user_data": "}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:01.391323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] validate_networks() for [('6f4844db-ed6c-4bba-97af-aa7e459b2e26', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:02:01.746145 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ae217dbe-a885-4abd-bbf9-648c4b1d093f tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a9c21f0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:01.777976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ae217dbe-a885-4abd-bbf9-648c4b1d093f tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 200 len: 287 microversion: 2.1 time: 0.035706 Jun 15 15:02:01.778811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 414/855] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:02:01 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:02:01.783886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:01.784500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:01.790598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:01.792461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:01.792461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:01.792461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:01.911321 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:02:01.911850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:02:01.912425 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:02:01.912839 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:02:01.913586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:02:01.924065 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:01.924533 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:01.925339 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:01.925774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:01.944697 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:02:01.950451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Getting quotas for user e367e391e68a477d861a515f846a8dfa and project c100074063c44d96adf93e0b0f080527. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:02:01.961606 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:02:01.964702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:02:02.019063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:02.122710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6afe16c0-b416-495c-a208-3fcc80e99f5f tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.835929 Jun 15 15:02:02.123529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 442/856] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:02:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:02:02.133545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b1e6444d-c49d-47ec-adce-ce792971c2e7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:02.134188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b1e6444d-c49d-47ec-adce-ce792971c2e7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:02.137346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:02.154089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:02.162548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-13a0574e-b564-410c-bcc3-267efdd969d7 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1276 microversion: 2.1 time: 0.382777 Jun 15 15:02:02.163127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 415/857] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:01 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1276 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:02.213758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b1e6444d-c49d-47ec-adce-ce792971c2e7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:02.222310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b1e6444d-c49d-47ec-adce-ce792971c2e7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1240 microversion: 2.1 time: 0.092537 Jun 15 15:02:02.222836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 443/858] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:02 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:02.790859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ee480e8b-8326-48b1-8d87-df9476100e72 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693aa8fb80>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:02.805821 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=8 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:02.821101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ee480e8b-8326-48b1-8d87-df9476100e72 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 200 len: 288 microversion: 2.1 time: 0.035252 Jun 15 15:02:02.821101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 416/859] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:02:02 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:02.832267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b11cb4e2-c5a5-467b-b6ad-f754b7b5db56 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a276ca0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:02.888368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-d7e6850e-d842-4a37-8291-c44f2072aac8 req-d0b734e8-f468-4973-b1b1-d02ce1a8a6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf20221-daaa-4dc2-87d6-a23729ea9a0a", "tag": "abd09198-523f-4d79-80c7-8726203d3972"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:02.902917 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-d7e6850e-d842-4a37-8291-c44f2072aac8 req-d0b734e8-f468-4973-b1b1-d02ce1a8a6df service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:02.903370 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-d7e6850e-d842-4a37-8291-c44f2072aac8 req-d0b734e8-f468-4973-b1b1-d02ce1a8a6df service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:02.915566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-d7e6850e-d842-4a37-8291-c44f2072aac8 req-d0b734e8-f468-4973-b1b1-d02ce1a8a6df service nova] Creating event network-changed:abd09198-523f-4d79-80c7-8726203d3972 for instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a on hv-cinder-84517 Jun 15 15:02:02.922967 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-d7e6850e-d842-4a37-8291-c44f2072aac8 req-d0b734e8-f468-4973-b1b1-d02ce1a8a6df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039646 Jun 15 15:02:02.923917 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 417/860] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:02.996011 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b11cb4e2-c5a5-467b-b6ad-f754b7b5db56 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 202 len: 0 microversion: 2.1 time: 0.162555 Jun 15 15:02:02.996011 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 444/861] 10.222.0.23 () {58 vars in 1253 bytes} [Wed Jun 15 15:02:02 2022] DELETE /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:02:03.002359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5d9c97f1-e4d8-4b95-95cf-cafce9c60468 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693aa730d0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:03.037119 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5d9c97f1-e4d8-4b95-95cf-cafce9c60468 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 200 len: 287 microversion: 2.1 time: 0.039137 Jun 15 15:02:03.037685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 418/862] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:02:02 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:03.179379 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:03.180080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:03.187601 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:03.188057 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:03.188841 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:03.189282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:03.240070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:03.240804 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:03.248243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:03.249549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:03.249549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:03.249990 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:03.351843 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:03.362461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0c32c149-ab93-4553-baca-0601ac6c11dd tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1244 microversion: 2.1 time: 0.126113 Jun 15 15:02:03.363032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 419/863] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:03 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1244 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:03.402806 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:03.410450 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c58ec9fd-cb63-447f-ad3b-7b60807f0bda tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1276 microversion: 2.1 time: 0.235181 Jun 15 15:02:03.412562 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 445/864] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:03 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:04.048908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-87223c8e-fc67-4f9b-ac54-01a33d6294c2 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a9c24c0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:04.075042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-87223c8e-fc67-4f9b-ac54-01a33d6294c2 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] HTTP exception thrown: Snapshot fd84d05f-44af-46ea-9e1f-e6d2a30447fd could not be found. Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-87223c8e-fc67-4f9b-ac54-01a33d6294c2 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Request method failure captured: Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd HTTP/1.1 Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfRjtm-8IuQRXi3BxGSvE6pn1Rf2FXqHE1BL1efjg-RvaXGDlCx4I5OYtvwGm23Wem5VdYzMdZYCT0yiazQ_M8jeI-wQ9qHbtfpBGV9qL72-wES3mnCl_c6OiP3TyyqCcoyNf66Neq5r_mVgqO4EK74kEL4G0TqfQGqCsg_nEBJgH6o Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:02:04.077555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: f0ce9a86447a454887631cdc67deb641 Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Snapshot fd84d05f-44af-46ea-9e1f-e6d2a30447fd could not be found. Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'fd84d05f-44af-46ea-9e1f-e6d2a30447fd'} Jun 15 15:02:04.079215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fd84d05f-44af-46ea-9e1f-e6d2a30447fd could not be found. (HTTP 404) (Request-ID: req-cdabaf00-f95f-4ec9-bdda-1f56ab0df1ed) Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:04.080216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:04.081572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fd84d05f-44af-46ea-9e1f-e6d2a30447fd could not be found. Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 15:02:04.083220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fd84d05f-44af-46ea-9e1f-e6d2a30447fd could not be found. Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fd84d05f-44af-46ea-9e1f-e6d2a30447fd could not be found. Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-87223c8e-fc67-4f9b-ac54-01a33d6294c2 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Returning 404 to user: Snapshot fd84d05f-44af-46ea-9e1f-e6d2a30447fd could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:04.084706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-87223c8e-fc67-4f9b-ac54-01a33d6294c2 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd" status: 404 len: 111 microversion: 2.1 time: 0.033977 Jun 15 15:02:04.085680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 420/865] 10.222.0.23 () {58 vars in 1250 bytes} [Wed Jun 15 15:02:04 2022] GET /compute/v2.1/os-snapshots/fd84d05f-44af-46ea-9e1f-e6d2a30447fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:04.088892 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fa03f00f-13b2-4871-8a66-3d276f96dddc tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a393040>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:04.334858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fa03f00f-13b2-4871-8a66-3d276f96dddc tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691" status: 202 len: 0 microversion: 2.1 time: 0.250691 Jun 15 15:02:04.335409 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 446/866] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 15:02:04 2022] DELETE /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:02:04.344239 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a981e6fc-6354-43c4-88c0-94706bd5fe76 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693aa4cb80>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:04.379262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:04.379937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:04.387362 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:04.387825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:04.388723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:04.389167 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:04.395915 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a981e6fc-6354-43c4-88c0-94706bd5fe76 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691" status: 200 len: 344 microversion: 2.1 time: 0.055298 Jun 15 15:02:04.401117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 421/867] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:04 2022] GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:04.428472 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:04.429114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:04.437749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:04.438587 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:04.439417 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:04.440177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:04.467223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:04.467223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c2b36539-2567-4ef2-a765-d9c987d84796 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1292 microversion: 2.1 time: 0.088621 Jun 15 15:02:04.467223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 447/868] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:04 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:04.589295 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:04.597118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2df668b6-561d-4228-869e-666d51054147 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.172586 Jun 15 15:02:04.597675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 422/869] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:04 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:05.410120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5583634b-1c58-44ff-8333-3a0f21c1dfd3 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a2aa790>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:05.439356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-5583634b-1c58-44ff-8333-3a0f21c1dfd3 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] HTTP exception thrown: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5583634b-1c58-44ff-8333-3a0f21c1dfd3 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Request method failure captured: Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 HTTP/1.1 Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfRjtm-8IuQRXi3BxGSvE6pn1Rf2FXqHE1BL1efjg-RvaXGDlCx4I5OYtvwGm23Wem5VdYzMdZYCT0yiazQ_M8jeI-wQ9qHbtfpBGV9qL72-wES3mnCl_c6OiP3TyyqCcoyNf66Neq5r_mVgqO4EK74kEL4G0TqfQGqCsg_nEBJgH6o Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:02:05.441722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: f0ce9a86447a454887631cdc67deb641 Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '2a56d576-ea98-491c-8d44-d5ae8e979691'} Jun 15 15:02:05.443294 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. (HTTP 404) (Request-ID: req-c5356ef4-a9fc-4162-98a6-22a3a50eac71) Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.448845 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:05.450594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 15:02:05.451876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5583634b-1c58-44ff-8333-3a0f21c1dfd3 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Returning 404 to user: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5583634b-1c58-44ff-8333-3a0f21c1dfd3 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691" status: 404 len: 109 microversion: 2.1 time: 0.037371 Jun 15 15:02:05.453197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 448/870] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:05 2022] GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:05.454665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-13088771-b6ba-4464-9f6b-01514c1440e0 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693a9c2ee0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:05.486123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:05.486123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:05.488320 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-13088771-b6ba-4464-9f6b-01514c1440e0 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] HTTP exception thrown: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-13088771-b6ba-4464-9f6b-01514c1440e0 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Request method failure captured: Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: DELETE /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 HTTP/1.1 Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfRjtm-8IuQRXi3BxGSvE6pn1Rf2FXqHE1BL1efjg-RvaXGDlCx4I5OYtvwGm23Wem5VdYzMdZYCT0yiazQ_M8jeI-wQ9qHbtfpBGV9qL72-wES3mnCl_c6OiP3TyyqCcoyNf66Neq5r_mVgqO4EK74kEL4G0TqfQGqCsg_nEBJgH6o Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:02:05.490279 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: f0ce9a86447a454887631cdc67deb641 Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '2a56d576-ea98-491c-8d44-d5ae8e979691'} Jun 15 15:02:05.491939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. (HTTP 404) (Request-ID: req-7b95eac0-45fa-433a-9683-15ef06631597) Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.492861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:02:05.494047 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 15:02:05.495273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-13088771-b6ba-4464-9f6b-01514c1440e0 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Returning 404 to user: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-13088771-b6ba-4464-9f6b-01514c1440e0 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691" status: 404 len: 109 microversion: 2.1 time: 0.040855 Jun 15 15:02:05.496735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 423/871] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 15:02:05 2022] DELETE /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:05.500206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-66c5b520-b7bb-462b-9449-779f10eab179 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Calling method '.version_select at 0x7f693aa670d0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:05.503351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:05.503825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:05.504613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:05.505058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:05.528976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-66c5b520-b7bb-462b-9449-779f10eab179 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] HTTP exception thrown: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-66c5b520-b7bb-462b-9449-779f10eab179 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Request method failure captured: Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 HTTP/1.1 Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfRjtm-8IuQRXi3BxGSvE6pn1Rf2FXqHE1BL1efjg-RvaXGDlCx4I5OYtvwGm23Wem5VdYzMdZYCT0yiazQ_M8jeI-wQ9qHbtfpBGV9qL72-wES3mnCl_c6OiP3TyyqCcoyNf66Neq5r_mVgqO4EK74kEL4G0TqfQGqCsg_nEBJgH6o Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:02:05.530973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/35b27a4dffff4144b63aab9d758b5687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 35b27a4dffff4144b63aab9d758b5687 Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2049228860 Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: f0ce9a86447a454887631cdc67deb641 Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2049228860-project Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '2a56d576-ea98-491c-8d44-d5ae8e979691'} Jun 15 15:02:05.532622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. (HTTP 404) (Request-ID: req-5b170d0c-45e5-43d0-8f39-06a9c58dee48) Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.533592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:05.535104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 15:02:05.536471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-66c5b520-b7bb-462b-9449-779f10eab179 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] Returning 404 to user: Volume 2a56d576-ea98-491c-8d44-d5ae8e979691 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-66c5b520-b7bb-462b-9449-779f10eab179 tempest-VolumesSnapshotsTestJSON-2049228860 tempest-VolumesSnapshotsTestJSON-2049228860-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691" status: 404 len: 109 microversion: 2.1 time: 0.035832 Jun 15 15:02:05.538501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 424/872] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:05 2022] GET /compute/v2.1/os-volumes/2a56d576-ea98-491c-8d44-d5ae8e979691 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:02:05.580799 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:05.590330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2e8003b5-a753-4c46-83c1-d8a9e0f69125 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1298 microversion: 2.1 time: 0.111314 Jun 15 15:02:05.596461 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 449/873] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:05 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:05.615719 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:05.616341 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:05.623644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:05.624102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:05.624968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:05.625310 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:06.039687 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:06.048527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3d5e1ac0-7a86-4c5c-a800-1d4a7dd52d6d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.437501 Jun 15 15:02:06.049111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 425/874] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:05 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:06.608549 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:06.609167 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:06.616159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:06.616603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:06.617365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:06.617798 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:06.785173 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:06.794773 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3f5c343b-77fc-440e-af53-6f835d18863a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1365 microversion: 2.1 time: 0.190283 Jun 15 15:02:06.795809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 450/875] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:06 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:07.065737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:07.066390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:07.073452 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:07.073910 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:07.074720 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:07.075160 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:07.116704 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-c719d5af-7e83-49b4-a5d9-360bacc958d2 req-636e44cb-3517-451f-9cca-1421ff8e4fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158292c6-a464-41ff-bbc2-3c3abe512dbd", "tag": "4401ae77-69bf-41f6-bd33-dc46fb458512"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:07.133079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-c719d5af-7e83-49b4-a5d9-360bacc958d2 req-636e44cb-3517-451f-9cca-1421ff8e4fd2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:07.133922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-c719d5af-7e83-49b4-a5d9-360bacc958d2 req-636e44cb-3517-451f-9cca-1421ff8e4fd2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:07.154814 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-c719d5af-7e83-49b4-a5d9-360bacc958d2 req-636e44cb-3517-451f-9cca-1421ff8e4fd2 service nova] Creating event network-changed:4401ae77-69bf-41f6-bd33-dc46fb458512 for instance 158292c6-a464-41ff-bbc2-3c3abe512dbd on hv-cinder-84517 Jun 15 15:02:07.162686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-c719d5af-7e83-49b4-a5d9-360bacc958d2 req-636e44cb-3517-451f-9cca-1421ff8e4fd2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055580 Jun 15 15:02:07.163524 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 451/876] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:07.457784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:07.465592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-753f766d-ea89-474d-a6ce-c8cf42adab95 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.403676 Jun 15 15:02:07.469300 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 426/877] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:07 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:07.825428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:07.826201 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:07.833509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:07.833956 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:07.834756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:07.835424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:08.043376 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:08.051181 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-54b7ef58-08c5-4c4a-9f9f-75d20ec0ffb2 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1365 microversion: 2.1 time: 0.240361 Jun 15 15:02:08.060636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 452/878] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:07 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:08.195072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a68b1fb8-fe14-4f52-ae2f-072c19816125 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Action: 'create', calling method: .version_select at 0x7f693a9ff310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1959636967", "metadata": {"Type": "work"}}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:08.486290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:08.486951 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:08.493329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:08.494038 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:08.494853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:08.495313 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:08.634844 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:08.642860 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a967c7cd-8ef2-4661-bd5a-43136f681fbe tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.164574 Jun 15 15:02:08.643454 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 453/879] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:08 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:08.958094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a68b1fb8-fe14-4f52-ae2f-072c19816125 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.880658 Jun 15 15:02:08.958728 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 427/880] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Jun 15 15:02:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 882 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 15:02:08.970149 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cb5a1d57-067c-4684-b7d1-c15545334422 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Calling method '.version_select at 0x7f693a289160>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:09.019820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-cb5a1d57-067c-4684-b7d1-c15545334422 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3" status: 200 len: 353 microversion: 2.1 time: 0.053366 Jun 15 15:02:09.020434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 454/881] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:08 2022] GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:09.068165 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:09.068780 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:09.075867 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:09.076323 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:09.077106 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:09.077544 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:09.214789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:09.222638 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b6ff06de-46f8-4cce-adcc-350b443c886a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1365 microversion: 2.1 time: 0.158482 Jun 15 15:02:09.225757 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 428/882] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:09 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:09.659653 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:09.660263 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:09.667143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:09.667601 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:09.668372 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:09.668810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:09.683690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:09.800423 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:09.809389 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7055830f-f69c-4b3d-8582-70e19e60732e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.153557 Jun 15 15:02:09.809950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 455/883] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:09 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:10.031986 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f02ad0bc-2d6a-4192-9069-8579863c6b74 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Calling method '.version_select at 0x7f693aa67040>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:10.079783 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f02ad0bc-2d6a-4192-9069-8579863c6b74 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3" status: 200 len: 354 microversion: 2.1 time: 0.051580 Jun 15 15:02:10.080364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 429/884] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:10 2022] GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:10.092415 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c1c66e3a-339d-4501-a6b7-8739851a1447 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Calling method '.version_select at 0x7f693a276ca0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:10.143036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c1c66e3a-339d-4501-a6b7-8739851a1447 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3" status: 200 len: 354 microversion: 2.1 time: 0.055558 Jun 15 15:02:10.143596 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 456/885] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:10 2022] GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:02:10.159951 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4f58007d-fac8-4512-983d-fc04f0da47df tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Calling method '.version_select at 0x7f693a9ffaf0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:10.240794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:10.241412 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:10.248248 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:10.248700 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:10.249590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:10.250038 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:10.375499 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4f58007d-fac8-4512-983d-fc04f0da47df tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3" status: 202 len: 0 microversion: 2.1 time: 0.219779 Jun 15 15:02:10.380326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 430/886] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 15:02:10 2022] DELETE /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:02:10.384293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d2d19644-96cc-4e2b-8c53-809a15d24a53 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Calling method '.version_select at 0x7f693aa79700>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:10.385028 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:10.392722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6b6f31cd-b788-40d2-8842-f896567da24a tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1365 microversion: 2.1 time: 0.155902 Jun 15 15:02:10.393290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 457/887] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:10 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:10.434773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d2d19644-96cc-4e2b-8c53-809a15d24a53 tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3" status: 200 len: 353 microversion: 2.1 time: 0.054589 Jun 15 15:02:10.435362 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 431/888] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:10 2022] GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:02:10.826995 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:10.827605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:10.833706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:10.834156 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:10.835037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:10.835481 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:10.966967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:10.974961 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-67ef1ba8-e840-447d-803c-b5907963c8e4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.151971 Jun 15 15:02:10.975518 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 458/889] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:10 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:11.258911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b317ea05-155e-4c6a-ac99-f6c8693e2ada tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:11.259509 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b317ea05-155e-4c6a-ac99-f6c8693e2ada tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:11.265571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b317ea05-155e-4c6a-ac99-f6c8693e2ada tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:11.266025 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b317ea05-155e-4c6a-ac99-f6c8693e2ada tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:11.266822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b317ea05-155e-4c6a-ac99-f6c8693e2ada tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:11.267263 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b317ea05-155e-4c6a-ac99-f6c8693e2ada tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:11.289570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b317ea05-155e-4c6a-ac99-f6c8693e2ada tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/ips" status: 200 len: 151 microversion: 2.20 time: 0.034989 Jun 15 15:02:11.290122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 432/890] 10.222.0.23 () {60 vars in 1288 bytes} [Wed Jun 15 15:02:11 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 15:02:11.410595 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:11.411419 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:11.418544 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:11.418992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:11.419760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:11.424459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:11.447459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-60c49683-57c7-44b9-b6ea-1826d1bfce9f tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Calling method '.version_select at 0x7f693aa79670>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:11.474691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-60c49683-57c7-44b9-b6ea-1826d1bfce9f tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] HTTP exception thrown: Volume d474f270-8cee-4999-9d7c-fc5ce2ac04b3 could not be found. Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-60c49683-57c7-44b9-b6ea-1826d1bfce9f tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Request method failure captured: Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3 HTTP/1.1 Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfRwhki1pSaxBBJ8oqaOQAlghU7qboMZAxxwXGBLZ2do4bO-hMDQcFZ_XHXnv1k00pscaSkVNedx3u0TUsq5XhHltGmAFUasBpaiSSXQY4iRFS0CdYTLBMYift9mBV9V5fZVvAoco5Hoe1TkxkyqSDMUwKPYJfGGe0a3ZDd3OwYxrmU Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 075d58aaf00a463aa8abef3086c7ef54 Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesGetTestJSON-2092556553 Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:02:11.476675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/075d58aaf00a463aa8abef3086c7ef54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/075d58aaf00a463aa8abef3086c7ef54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_075d58aaf00a463aa8abef3086c7ef54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/075d58aaf00a463aa8abef3086c7ef54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesGetTestJSON-2092556553 Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 075d58aaf00a463aa8abef3086c7ef54 Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesGetTestJSON-2092556553 Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesGetTestJSON-2092556553-project Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: 9668d7c47ce048c3b19c57bf4bea2be4 Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesGetTestJSON-2092556553-project Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Volume d474f270-8cee-4999-9d7c-fc5ce2ac04b3 could not be found. Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'd474f270-8cee-4999-9d7c-fc5ce2ac04b3'} Jun 15 15:02:11.479405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d474f270-8cee-4999-9d7c-fc5ce2ac04b3 could not be found. (HTTP 404) (Request-ID: req-7fd2fabd-f66f-4c3c-a411-135dacdd268c) Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:11.480354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:02:11.481746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d474f270-8cee-4999-9d7c-fc5ce2ac04b3 could not be found. Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 15:02:11.484177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d474f270-8cee-4999-9d7c-fc5ce2ac04b3 could not be found. Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d474f270-8cee-4999-9d7c-fc5ce2ac04b3 could not be found. Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-60c49683-57c7-44b9-b6ea-1826d1bfce9f tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] Returning 404 to user: Volume d474f270-8cee-4999-9d7c-fc5ce2ac04b3 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-60c49683-57c7-44b9-b6ea-1826d1bfce9f tempest-VolumesGetTestJSON-2092556553 tempest-VolumesGetTestJSON-2092556553-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3" status: 404 len: 109 microversion: 2.1 time: 0.035442 Jun 15 15:02:11.486127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 433/891] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:02:11 2022] GET /compute/v2.1/os-volumes/d474f270-8cee-4999-9d7c-fc5ce2ac04b3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:02:11.561189 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:11.569401 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-806ae7c4-5051-4fd1-8913-d665ed9ab813 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1365 microversion: 2.1 time: 0.162889 Jun 15 15:02:11.569971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 459/892] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:11 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:11.995988 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:11.996696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:11.999726 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:12.012724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:12.013215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:12.014027 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:12.014503 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:12.127084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-82fe86f4-d9d3-4d8d-8edd-39d61f40ec3c req-d1ade45b-5111-4493-a59e-493e813e0c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158292c6-a464-41ff-bbc2-3c3abe512dbd", "name": "network-vif-plugged", "status": "completed", "tag": "4401ae77-69bf-41f6-bd33-dc46fb458512"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:12.131283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:12.144910 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-82fe86f4-d9d3-4d8d-8edd-39d61f40ec3c req-d1ade45b-5111-4493-a59e-493e813e0c72 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:12.144910 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-82fe86f4-d9d3-4d8d-8edd-39d61f40ec3c req-d1ade45b-5111-4493-a59e-493e813e0c72 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:12.149941 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-82fe86f4-d9d3-4d8d-8edd-39d61f40ec3c req-d1ade45b-5111-4493-a59e-493e813e0c72 service nova] Creating event network-vif-plugged:4401ae77-69bf-41f6-bd33-dc46fb458512 for instance 158292c6-a464-41ff-bbc2-3c3abe512dbd on hv-cinder-84517 Jun 15 15:02:12.155077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-82fe86f4-d9d3-4d8d-8edd-39d61f40ec3c req-d1ade45b-5111-4493-a59e-493e813e0c72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031606 Jun 15 15:02:12.156345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 460/893] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:02:12.194164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:12.205132 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-06a153bf-200d-4d86-b6e8-8d876b8e9340 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.215822 Jun 15 15:02:12.205976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 434/894] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:11 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:12.583990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=14 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:12.590405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:12.591376 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:12.597975 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:12.598575 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:12.599671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:12.600236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:12.763707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:12.771504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e7b75437-70dd-4777-aafa-724b73e73b80 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1365 microversion: 2.1 time: 0.188485 Jun 15 15:02:12.772068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 461/895] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:12 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:13.223980 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:13.224591 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:13.231332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:13.231786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:13.232550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:13.232985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:13.366892 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:13.375297 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b52f76dd-c33f-4a5a-bd6d-0522679f8fee tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.155807 Jun 15 15:02:13.375902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 435/896] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:13 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:13.789693 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:13.790520 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:13.798260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:13.798737 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:13.799509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:13.799954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:13.941139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:13.949022 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-78695dae-9d31-4a51-b1b5-5b0310e224a8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1365 microversion: 2.1 time: 0.163845 Jun 15 15:02:13.950204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 462/897] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:13 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:14.174329 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:14.181576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-f05ec63d-5e49-4538-8809-23dc3abee318 req-0aa63209-b3b4-495e-9f0e-ba8d0d64adf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf20221-daaa-4dc2-87d6-a23729ea9a0a", "name": "network-vif-plugged", "status": "completed", "tag": "abd09198-523f-4d79-80c7-8726203d3972"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:14.182837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:14.189536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.192573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.193368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.193810 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.201939 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f05ec63d-5e49-4538-8809-23dc3abee318 req-0aa63209-b3b4-495e-9f0e-ba8d0d64adf4 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.207935 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f05ec63d-5e49-4538-8809-23dc3abee318 req-0aa63209-b3b4-495e-9f0e-ba8d0d64adf4 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.213658 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-f05ec63d-5e49-4538-8809-23dc3abee318 req-0aa63209-b3b4-495e-9f0e-ba8d0d64adf4 service nova] Creating event network-vif-plugged:abd09198-523f-4d79-80c7-8726203d3972 for instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a on hv-cinder-84517 Jun 15 15:02:14.219255 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-f05ec63d-5e49-4538-8809-23dc3abee318 req-0aa63209-b3b4-495e-9f0e-ba8d0d64adf4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043274 Jun 15 15:02:14.220161 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 463/898] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:14.224899 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lazy-loading 'flavor' on Instance uuid 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:02:14.393277 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:14.394092 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:14.401401 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.401947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.402913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.403425 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.551994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:14.563906 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3ca4f0c0-5c20-4ce3-b7f7-b99925912731 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.174937 Jun 15 15:02:14.566410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 464/899] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:14 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:14.827940 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3ad22f92-10f0-4598-b71b-7e5c1a4dd412 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/action" status: 202 len: 0 microversion: 2.20 time: 0.657321 Jun 15 15:02:14.828599 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 436/900] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Jun 15 15:02:14 2022] POST /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:02:14.836955 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:14.838285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:14.845151 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.845606 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.846691 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.847136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.973570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:14.974416 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:14.985030 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.985693 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:14.991268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:14.992029 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:15.015714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:15.025600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:15.027440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:15.028751 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-dc3f7629-1845-49ac-a327-6330bc58acda tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.196065 Jun 15 15:02:15.034350 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 465/901] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:14 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:15.141129 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:15.149203 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8a9fd787-6e1e-4cff-8414-9133e6b97381 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1555 microversion: 2.1 time: 0.181636 Jun 15 15:02:15.149918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 437/902] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:14 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:15.170060 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6a696f8e-fabf-40ad-b19a-8242b1a7d2b1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:15.170611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6a696f8e-fabf-40ad-b19a-8242b1a7d2b1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:15.176668 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6a696f8e-fabf-40ad-b19a-8242b1a7d2b1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:15.177130 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6a696f8e-fabf-40ad-b19a-8242b1a7d2b1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:15.177897 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6a696f8e-fabf-40ad-b19a-8242b1a7d2b1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:15.178380 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6a696f8e-fabf-40ad-b19a-8242b1a7d2b1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:15.255488 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6a696f8e-fabf-40ad-b19a-8242b1a7d2b1 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090133 Jun 15 15:02:15.256101 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 466/903] 10.222.0.23 () {58 vars in 1274 bytes} [Wed Jun 15 15:02:15 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:15.582072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:15.582998 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:15.590141 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:15.590855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:15.591639 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:15.592237 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:15.813571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:15.822122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d508aadd-bbd6-4dca-824b-45a90718cd75 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.243824 Jun 15 15:02:15.832182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 438/904] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:15 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:16.053170 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:16.053809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:16.062445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:16.062912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:16.063744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:16.064206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:16.295756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:16.304574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:16.306277 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:16.308138 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-779934d6-a432-4f6c-8c8b-fda04497fc7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.259466 Jun 15 15:02:16.308768 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 467/905] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:16 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:16.739073 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-f087ef64-3651-4208-95dc-48dbb16df2ef req-a85a6ac6-1288-4180-803c-7b94d178cd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158292c6-a464-41ff-bbc2-3c3abe512dbd", "tag": "4401ae77-69bf-41f6-bd33-dc46fb458512"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:16.747720 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f087ef64-3651-4208-95dc-48dbb16df2ef req-a85a6ac6-1288-4180-803c-7b94d178cd06 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:16.748163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f087ef64-3651-4208-95dc-48dbb16df2ef req-a85a6ac6-1288-4180-803c-7b94d178cd06 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:16.759710 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-f087ef64-3651-4208-95dc-48dbb16df2ef req-a85a6ac6-1288-4180-803c-7b94d178cd06 service nova] Creating event network-changed:4401ae77-69bf-41f6-bd33-dc46fb458512 for instance 158292c6-a464-41ff-bbc2-3c3abe512dbd on hv-cinder-84517 Jun 15 15:02:16.764860 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-f087ef64-3651-4208-95dc-48dbb16df2ef req-a85a6ac6-1288-4180-803c-7b94d178cd06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030041 Jun 15 15:02:16.765456 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 439/906] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:16.840529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:16.841565 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:16.849972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:16.850688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:16.852188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:16.853052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:17.031683 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:17.039958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f71755d8-01fb-4e7b-9657-6534917b21db tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1264 microversion: 2.1 time: 0.204501 Jun 15 15:02:17.040962 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 468/907] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:16 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:17.332294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:17.334390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:17.346581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:17.346581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:17.347264 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:17.347744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:17.573197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:17.583204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:17.584784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:17.586286 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2b9ce509-f0ef-4a75-a374-467e11a12796 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.261962 Jun 15 15:02:17.586690 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 440/908] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:17 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:18.059206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:18.059829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:18.066503 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.066963 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.067760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.068205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.201809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:18.218855 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2fa5b996-04a3-46a6-b7e4-6f6898dc466c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1451 microversion: 2.1 time: 0.155391 Jun 15 15:02:18.218855 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 469/909] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:18 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:18.235210 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:18.235875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:18.242346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.242806 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.243578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.244756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.247399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:18.386860 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:18.394859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ab0d0672-2408-4088-8057-7db14f17c73d tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1451 microversion: 2.1 time: 0.163420 Jun 15 15:02:18.395419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 441/910] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:18 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:18.606073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:18.607283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:18.615802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.616316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.617059 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:18.617651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:18.764219 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:18.772293 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:18.773914 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:18.775846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0ac25655-b790-402f-981a-0158b0f2c015 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.173853 Jun 15 15:02:18.776668 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 470/911] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:18 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:19.790082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:19.792441 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:19.795323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:19.795933 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:19.799854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:19.802610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:19.802610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:19.802801 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:19.802899 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:19.803166 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:19.804115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:19.804555 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:19.829492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lazy-loading 'flavor' on Instance uuid ef0407de-1fe3-40c9-92ff-a14f1a81f985 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:02:19.948937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:19.956978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:19.958522 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:19.959749 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-288a939a-4168-451d-9d98-44c96666bc96 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.169758 Jun 15 15:02:19.960302 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 471/912] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:19 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:02:20.207915 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-34123dfc-0f09-4c06-8d04-830f159aafc2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "POST /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985/action" status: 202 len: 0 microversion: 2.1 time: 0.422520 Jun 15 15:02:20.208492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 442/913] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:02:19 2022] POST /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:02:20.217743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:20.218487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:20.224858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:20.225310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:20.226113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:20.226548 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:20.369556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:20.378686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a13f6088-553e-4916-897c-2da6acb799d1 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.165716 Jun 15 15:02:20.380711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 472/914] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:20 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:20.983809 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:20.983809 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:20.988021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:20.988600 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:20.989636 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:20.990200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:20.991501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-d10ca38e-2320-4656-b11c-d447eae66615 req-65c3c1f0-9821-475a-ac00-35d905c03d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf20221-daaa-4dc2-87d6-a23729ea9a0a", "tag": "abd09198-523f-4d79-80c7-8726203d3972"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:21.001310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d10ca38e-2320-4656-b11c-d447eae66615 req-65c3c1f0-9821-475a-ac00-35d905c03d8e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:21.001669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-d10ca38e-2320-4656-b11c-d447eae66615 req-65c3c1f0-9821-475a-ac00-35d905c03d8e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:21.014132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-d10ca38e-2320-4656-b11c-d447eae66615 req-65c3c1f0-9821-475a-ac00-35d905c03d8e service nova] Creating event network-changed:abd09198-523f-4d79-80c7-8726203d3972 for instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a on hv-cinder-84517 Jun 15 15:02:21.032509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-d10ca38e-2320-4656-b11c-d447eae66615 req-65c3c1f0-9821-475a-ac00-35d905c03d8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045843 Jun 15 15:02:21.033403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 473/915] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:02:21.160395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:21.169989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:21.171815 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:21.173323 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-260da3c4-fcd5-455e-81fa-6899bdf77f38 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.198118 Jun 15 15:02:21.174507 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 443/916] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:20 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:02:21.397002 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:21.398006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:21.404775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:21.405405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:21.406763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:21.406890 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:21.639123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:21.647714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-21df1d8c-79c1-4426-b594-1afc3ad30749 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.254953 Jun 15 15:02:21.649305 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 474/917] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:21 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:22.191955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:22.192565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:22.199790 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.200240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.201008 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.201618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.334597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:22.343495 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:22.345008 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:22.346465 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1d802afe-a2e8-42bf-a995-d1eda1931c04 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.158360 Jun 15 15:02:22.347032 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 444/918] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:22 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:22.665221 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:22.666410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:22.673174 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.673621 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.674424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:22.674920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:22.690783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:22.813310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:22.820836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fbd7dbea-243c-47f5-bb6d-9478cd6a34a2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.159637 Jun 15 15:02:22.821399 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 475/919] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:22 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:23.364931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:23.365439 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:23.372839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:23.373287 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:23.374048 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:23.374511 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:23.507673 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:23.512439 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:23.513962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:23.515166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-46a4e61d-831f-4334-8581-ee5c29ba88a7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.154259 Jun 15 15:02:23.515712 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 445/920] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:23 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:23.838493 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:23.839125 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:23.845982 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:23.846516 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:23.847296 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:23.847739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:23.982336 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:23.990066 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-dbd699f8-a407-4c5a-8124-570afacd3a45 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.155591 Jun 15 15:02:23.990660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 476/921] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:23 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:24.534061 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:24.534816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:24.543712 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:24.544171 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:24.544952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:24.545394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:24.741451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:24.750089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:24.751613 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:24.752767 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8214a8c1-1be8-4237-af72-d84ae1650cdd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.222676 Jun 15 15:02:24.763715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 446/922] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:24 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:25.008395 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:25.008913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:25.016432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:25.016886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:25.017768 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:25.018071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:25.152485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:25.160321 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3bec69ee-8bca-4e1c-a961-8b7c0bf30514 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.156020 Jun 15 15:02:25.160889 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 477/923] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:25 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:25.771610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:25.772220 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:25.779189 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:25.779662 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:25.780446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:25.781037 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:25.955350 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:25.963856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:25.965460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:25.966683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-95f5b673-e453-4ddd-985c-10ecc79542d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.198978 Jun 15 15:02:25.967248 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 447/924] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:25 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:26.176929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:26.177612 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:26.184404 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:26.184980 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:26.185774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:26.186288 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:26.319685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:26.328773 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-52760099-4565-4f91-a031-518b8845758c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.155826 Jun 15 15:02:26.329344 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 478/925] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:26 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:26.984734 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:26.985351 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:26.992030 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:26.992480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:26.993259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:26.993724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:27.132883 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:27.141641 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:27.143185 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:27.144396 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e1295dab-d6e7-498e-98fc-3edca7ae99e7 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.163517 Jun 15 15:02:27.144983 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 448/926] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:26 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:27.346874 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:27.347495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:27.354181 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:27.358394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:27.358394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:27.358394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:27.488603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:27.497372 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-86367f79-8a42-425e-b988-1dcc7ab31349 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.154559 Jun 15 15:02:27.497939 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 479/927] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:27 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:28.163260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:28.163864 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:28.171213 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:28.171748 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:28.172532 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:28.172978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:28.310723 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:28.319311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:28.320889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:28.322166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e4f38ff7-72f8-44c3-945a-79fe7b9239c9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.162809 Jun 15 15:02:28.322753 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 449/928] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:28 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:02:28.514934 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:28.515660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:28.522139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:28.522637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:28.523399 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:28.523836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:28.666893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:28.676724 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-01c3d662-bd01-43ad-8ab2-eb84bdd62576 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.164438 Jun 15 15:02:28.686658 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 480/929] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:28 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:29.340908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:29.341536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:29.348446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:29.348955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:29.349723 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:29.350163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:29.482394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:29.496650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:29.498194 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:29.499377 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9967a178-ed46-49e9-83c0-3b03f730bb10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.162479 Jun 15 15:02:29.499920 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 450/930] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:29 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:29.694782 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:29.695644 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:29.702633 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:29.703137 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:29.703913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:29.704360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:29.838407 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:29.846921 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3bc0bd7c-7eaf-4b34-a922-29da350b2dbf tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.156297 Jun 15 15:02:29.847538 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 481/931] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:29 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:30.519330 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:30.519873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:30.527610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:30.530737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:30.530737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:30.530737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:30.668393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:30.678881 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:30.680621 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:30.682821 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e7fa0f23-2897-4d47-a92d-52cd6a57c0ec tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.167482 Jun 15 15:02:30.683576 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 451/932] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:30 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:30.864594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:30.865183 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:30.872596 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:30.873073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:30.873854 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:30.874321 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:31.079037 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:31.088541 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9840b7e8-a8ec-4ec3-a749-e954f303d30b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.227825 Jun 15 15:02:31.100068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 482/933] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:30 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:31.701417 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:31.702038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:31.708540 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:31.711565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:31.711565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:31.711565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:31.844567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:31.854556 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:31.856150 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:31.857839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-398c3f86-b9dd-4013-b7b0-43e7b3dc61bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.160227 Jun 15 15:02:31.858516 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 452/934] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:31 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:32.105381 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:32.106047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:32.112773 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.113260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:32.114074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.114512 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:32.251816 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:32.259770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-606b2dab-4cb4-4360-9a36-c62f07f3bdba tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.158340 Jun 15 15:02:32.260335 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 483/935] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:32 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:32.878398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:32.879007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:32.886517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.893547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:32.893547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:32.893547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:33.022598 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:33.032021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:33.033531 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:33.034768 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b2f54bf8-da70-44f9-b7cf-de9933ebe64a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.160343 Jun 15 15:02:33.035314 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 453/936] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:32 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:33.277429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:33.278045 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:33.284942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:33.285392 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:33.286183 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:33.286639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:33.442022 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:33.451238 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-abc17eec-1be6-4fc5-88ec-29a93ff761be tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.178327 Jun 15 15:02:33.451815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 484/937] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:33 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:34.052829 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:34.053432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:34.061317 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.061765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.062557 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.063052 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.196261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:34.204582 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:34.206130 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:34.207321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-11d0f867-740c-4bed-b6a0-615653b5f6bb tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.158444 Jun 15 15:02:34.207875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 454/938] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:34 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:34.471701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:34.472319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:34.474741 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=76 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:34.479550 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.480015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.480791 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:34.481231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:34.622846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:34.630858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1c7e3cf7-4f4f-46ae-80db-f6e382844d8e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.163248 Jun 15 15:02:34.631430 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 485/939] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:34 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:35.230575 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:35.231177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:35.237826 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.238305 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:35.239095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.239527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:35.373118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:35.375490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:35.383258 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:35.385602 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:35.386911 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ba21fd36-5d92-4afc-af0c-c7757f560fa3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.161357 Jun 15 15:02:35.387469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 455/940] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:35 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:35.651535 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:35.652987 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:35.660180 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.660877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:35.661687 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.662432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:35.798282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:35.806610 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9bdc8bad-e1a9-4da8-98b4-bddcf34023d0 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1510 microversion: 2.1 time: 0.161336 Jun 15 15:02:35.807175 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 486/941] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:35 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:35.823433 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0fd429e4-bb6a-472a-8113-e61dd1049b0c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:35.824001 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0fd429e4-bb6a-472a-8113-e61dd1049b0c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:35.830405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0fd429e4-bb6a-472a-8113-e61dd1049b0c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.830857 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0fd429e4-bb6a-472a-8113-e61dd1049b0c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:35.831621 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0fd429e4-bb6a-472a-8113-e61dd1049b0c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:35.832070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0fd429e4-bb6a-472a-8113-e61dd1049b0c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:36.110984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-8c8fc06e-47b2-4872-af8d-d39dffd9dfeb req-7b2e8fb1-b355-4481-91df-447d96894521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0407de-1fe3-40c9-92ff-a14f1a81f985", "name": "network-vif-unplugged", "status": "completed", "tag": "e4963401-4f83-4506-b6d9-cef4682f75eb"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:36.110984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-8c8fc06e-47b2-4872-af8d-d39dffd9dfeb req-7b2e8fb1-b355-4481-91df-447d96894521 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:36.110984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-8c8fc06e-47b2-4872-af8d-d39dffd9dfeb req-7b2e8fb1-b355-4481-91df-447d96894521 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:36.121250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.compute.server_external_events [req-8c8fc06e-47b2-4872-af8d-d39dffd9dfeb req-7b2e8fb1-b355-4481-91df-447d96894521 service nova] Unable to find a host for instance ef0407de-1fe3-40c9-92ff-a14f1a81f985. Dropping event network-vif-unplugged {{(pid=124694) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 15:02:36.122144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-8c8fc06e-47b2-4872-af8d-d39dffd9dfeb req-7b2e8fb1-b355-4481-91df-447d96894521 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024680 Jun 15 15:02:36.122760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 487/942] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 15 15:02:36.175754 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0fd429e4-bb6a-472a-8113-e61dd1049b0c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "POST /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985/action" status: 202 len: 0 microversion: 2.1 time: 0.356439 Jun 15 15:02:36.176364 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 456/943] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:02:35 2022] POST /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:02:36.186143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:36.186683 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:36.192810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:36.193264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:36.194034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:36.194545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:36.370034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:36.379216 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-98c4b816-94fa-4739-b83c-15cea7065d18 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1518 microversion: 2.1 time: 0.197840 Jun 15 15:02:36.380183 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 488/944] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:36 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:36.408527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:36.409133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:36.417136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:36.417488 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:36.418285 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:36.418729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:36.557733 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:36.565781 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:36.572682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:36.572682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a6388e1b-276c-41a9-9132-94dcc38f8500 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1744 microversion: 2.20 time: 0.164115 Jun 15 15:02:36.572682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 457/945] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:36 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:37.398120 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:37.398829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:37.405729 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:37.406203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:37.407048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:37.407488 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:37.546282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:37.556721 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-427e7b8b-da5f-4978-868b-9ffdb902d66b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1518 microversion: 2.1 time: 0.160267 Jun 15 15:02:37.557332 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 489/946] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:37 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:37.592085 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:37.592780 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:37.599590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:37.600044 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:37.600816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:37.601259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:37.746570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:37.754730 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:37.756237 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:37.757397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-992c869d-1f29-4b92-a7cd-ad85ee4e7ca2 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1744 microversion: 2.20 time: 0.169435 Jun 15 15:02:37.757947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 458/947] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:37 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:38.574280 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:38.576126 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:38.581545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:38.582000 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:38.582830 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:38.583270 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:38.729385 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:38.737536 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f922f744-138f-4423-86e6-8d6b22f688c7 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1520 microversion: 2.1 time: 0.167746 Jun 15 15:02:38.739449 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 490/948] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:38 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:38.776797 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:38.777409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:38.784118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:38.784570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:38.785338 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:38.785778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:38.922276 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:38.931229 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:38.932497 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:38.933648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7f5f91e8-a2f4-45b9-83e7-470e3d062f44 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1744 microversion: 2.20 time: 0.160908 Jun 15 15:02:38.934303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 459/949] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:38 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:39.757030 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:39.767688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:39.777152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:39.777902 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:39.779556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:39.780005 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:39.924266 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:39.932599 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-726f2702-0800-4151-b572-a8c0334a0cd8 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1520 microversion: 2.1 time: 0.179782 Jun 15 15:02:39.933159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 491/950] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:39 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:39.952411 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:39.953025 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:39.959858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:39.960291 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:39.961067 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:39.962191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:40.108992 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:40.118925 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:40.120899 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:40.122731 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3eaac2c8-4651-40ed-bbad-7e93fcc5a8b1 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.174018 Jun 15 15:02:40.123442 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 460/951] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:39 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:40.217921 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-2d5c7347-7ee0-4dec-954d-055d4f1b2840 req-d7076cd1-d9bf-497a-91fb-fbc1ea51d370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1", "name": "network-vif-plugged", "status": "completed", "tag": "3c15b40b-3126-4ab0-8e3c-b2ed2188737c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:40.228421 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-2d5c7347-7ee0-4dec-954d-055d4f1b2840 req-d7076cd1-d9bf-497a-91fb-fbc1ea51d370 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:40.231771 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-2d5c7347-7ee0-4dec-954d-055d4f1b2840 req-d7076cd1-d9bf-497a-91fb-fbc1ea51d370 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:40.248707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-2d5c7347-7ee0-4dec-954d-055d4f1b2840 req-d7076cd1-d9bf-497a-91fb-fbc1ea51d370 service nova] Creating event network-vif-plugged:3c15b40b-3126-4ab0-8e3c-b2ed2188737c for instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 on hv-cinder-84517 Jun 15 15:02:40.253935 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-2d5c7347-7ee0-4dec-954d-055d4f1b2840 req-d7076cd1-d9bf-497a-91fb-fbc1ea51d370 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045938 Jun 15 15:02:40.255958 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 492/952] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:40.949950 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:40.950594 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:40.957278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:40.957884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:40.960929 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:40.963304 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:41.145871 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:41.146627 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:41.161017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:41.161017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:41.161017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:41.165260 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:41.207761 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:41.430539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:41.440138 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:41.441814 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:41.443415 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b793766f-21b1-4d50-a395-f6ffc1268909 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.303247 Jun 15 15:02:41.455866 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 493/953] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:41 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:41.469205 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:41.478270 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5d903a4c-eb6f-4d60-bb4a-fe0d9211d74a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.533147 Jun 15 15:02:41.478841 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 461/954] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:40 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:42.304440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b91618cf-8e85-4dab-8ed1-003abea11226 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:42.306320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b91618cf-8e85-4dab-8ed1-003abea11226 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:42.315766 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b91618cf-8e85-4dab-8ed1-003abea11226 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.316996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b91618cf-8e85-4dab-8ed1-003abea11226 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.318053 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b91618cf-8e85-4dab-8ed1-003abea11226 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.318710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b91618cf-8e85-4dab-8ed1-003abea11226 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.363883 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b91618cf-8e85-4dab-8ed1-003abea11226 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/ips" status: 200 len: 146 microversion: 2.1 time: 0.068132 Jun 15 15:02:42.364462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 494/955] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 15:02:42 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/ips => generated 146 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:42.464521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:42.465357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:42.473044 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.473522 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.474395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.474864 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.500118 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:42.510980 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:42.526206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.527558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.528809 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:42.529405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:42.842526 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:42.845017 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:42.853789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f5422c27-fb11-4291-9134-86898a197155 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.362197 Jun 15 15:02:42.854672 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 495/956] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:42 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:02:42.855264 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:42.858955 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:42.860230 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1d2ffe4e-af7f-4037-81ad-0ffc88078e6e tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.400742 Jun 15 15:02:42.860830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 462/957] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:42 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:43.873013 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:43.873832 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:43.879416 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:43.880112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:43.889510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.890445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:43.891503 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.892111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:43.892501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.893030 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:43.894924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:43.902833 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:44.243938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:44.259441 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-cc946ba8-5f7d-495e-997b-9204df893c6a tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.392094 Jun 15 15:02:44.264095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 496/958] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:43 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:44.303640 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:44.320588 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:44.322270 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:44.323458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e6cbead1-2816-4455-964b-a0e05ba5cf7d tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.448311 Jun 15 15:02:44.324380 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 463/959] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:43 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:45.281676 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:45.282217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:45.289329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:45.290319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:45.291404 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:45.291851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:45.344417 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:45.345033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:45.347945 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=62 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:45.352913 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:45.353708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:45.354751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:45.355411 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:45.497289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:45.517645 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-25918a85-db3c-4fa6-84a4-0c916245e85b tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.239867 Jun 15 15:02:45.518777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 497/960] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:45 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:45.575399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:45.584291 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:45.585796 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:45.587145 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-75fb2334-69c9-43ef-bc0f-9490456f344b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.248935 Jun 15 15:02:45.587705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 464/961] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:45 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:02:45.730057 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1af6e35e-d3f9-4d37-b19b-286908d55814 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff09296d-2952-4a6b-b2f2-6838e16e0387"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:45.731164 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1af6e35e-d3f9-4d37-b19b-286908d55814 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:45.737824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1af6e35e-d3f9-4d37-b19b-286908d55814 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:45.738343 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1af6e35e-d3f9-4d37-b19b-286908d55814 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:45.739369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1af6e35e-d3f9-4d37-b19b-286908d55814 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:45.739875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1af6e35e-d3f9-4d37-b19b-286908d55814 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:46.535553 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:46.536178 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:46.543399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:46.543852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:46.544730 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:46.545195 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:46.686424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:46.694080 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5191c2fd-fd16-4d97-9ba7-94846364c941 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.162677 Jun 15 15:02:46.694669 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 465/962] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:46 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:46.699616 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:46.700243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:46.706019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:46.706508 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:46.707273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:46.707710 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:46.842998 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:46.851427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:46.854712 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:46.854850 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7ea1f1d0-71a1-46c1-abd2-ac3d71aed3c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.158763 Jun 15 15:02:46.855752 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 466/963] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:46 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:47.269938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1af6e35e-d3f9-4d37-b19b-286908d55814 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.544583 Jun 15 15:02:47.271364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 498/964] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 15:02:45 2022] POST /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments => generated 194 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:47.716275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:47.717518 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:47.725549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:47.727042 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:47.728176 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:47.728812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:47.876377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:47.878146 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:47.887017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:47.889841 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:47.891068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:47.891632 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:47.901087 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:47.913333 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9e2e585c-5678-4e47-aa3f-10224c387779 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.202928 Jun 15 15:02:47.914797 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 467/965] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:47 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:48.057945 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:48.067532 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:48.069069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:48.073114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c1b74b9f-705c-40f1-9436-d5a692f23b49 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.200866 Jun 15 15:02:48.073936 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 499/966] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:47 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:48.941206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:48.941206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:48.941206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:48.941931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:48.942841 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:48.943515 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.091947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:49.092622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:49.099899 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:49.100637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.101936 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:49.102600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:49.116064 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:49.128104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d613ec86-7517-4bcf-94f2-dc098d32911f tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.200187 Jun 15 15:02:49.139323 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 468/967] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:48 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:49.262856 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:49.272641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:49.275135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:49.277247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3610a57c-dc5e-42f3-9bc6-12729412d496 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.188988 Jun 15 15:02:49.289235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 500/968] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:49 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:50.146115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:50.146667 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:50.154382 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:50.154907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:50.155740 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:50.156176 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:50.296479 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:50.297317 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:50.308449 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:50.308933 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:50.309725 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:50.310189 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:50.335557 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:50.344222 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0f42709e-613c-46da-95d6-b54fdc80f509 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.202161 Jun 15 15:02:50.344795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 469/969] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:50 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:50.455604 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:50.464651 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:50.466144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:50.467327 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-782a1215-1597-4748-aa60-620cbc2ee45b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.175034 Jun 15 15:02:50.467886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 501/970] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:50 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:51.370051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:51.370730 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:51.377144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.377679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.380558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.380558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.506139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:51.506836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:51.515805 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.520611 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.521750 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:51.522478 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:51.559038 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:51.568501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-739e9bf4-f9a3-4018-a9b0-126c82cc11ae tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.208252 Jun 15 15:02:51.583240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 470/971] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:51 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:51.740670 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:51.753249 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:51.754821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:51.756008 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8a01789a-cb97-41cf-a336-6f0f4c431199 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.253818 Jun 15 15:02:51.756577 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 502/972] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:51 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:52.590581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:52.591179 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:52.597876 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:52.598371 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:52.599133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:52.599567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:52.614882 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:02:52.744051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:52.751873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-734767b3-2c8b-45d9-8ff7-753d7760162e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.166244 Jun 15 15:02:52.752437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 471/973] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:52 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:52.776744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:52.777364 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:52.784092 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:52.784480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:52.785258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:52.785736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:52.879088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-91cf83fa-53b4-47c1-acb3-44403f270e17 req-5668b40a-a7c2-44f4-88e0-8938417882a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0407de-1fe3-40c9-92ff-a14f1a81f985", "name": "network-vif-plugged", "status": "completed", "tag": "e4963401-4f83-4506-b6d9-cef4682f75eb"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:52.888395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-91cf83fa-53b4-47c1-acb3-44403f270e17 req-5668b40a-a7c2-44f4-88e0-8938417882a8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:52.889209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-91cf83fa-53b4-47c1-acb3-44403f270e17 req-5668b40a-a7c2-44f4-88e0-8938417882a8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:52.902329 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-91cf83fa-53b4-47c1-acb3-44403f270e17 req-5668b40a-a7c2-44f4-88e0-8938417882a8 service nova] Creating event network-vif-plugged:e4963401-4f83-4506-b6d9-cef4682f75eb for instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 on hv-cinder-84517 Jun 15 15:02:52.906770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-91cf83fa-53b4-47c1-acb3-44403f270e17 req-5668b40a-a7c2-44f4-88e0-8938417882a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039951 Jun 15 15:02:52.907537 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 472/974] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:02:52.929820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:52.941333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:52.942953 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:52.944145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a072691d-219b-4e72-ba81-1e89785f635a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1739 microversion: 2.20 time: 0.171433 Jun 15 15:02:52.944851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 503/975] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:52 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:53.769984 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:53.771000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:53.778808 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:53.779378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:53.780245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:53.780779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:53.963217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:53.964198 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:53.971383 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:53.971913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:53.972907 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:53.973348 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:54.118621 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:54.126473 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3ac48d8c-ac02-4b81-880a-9957c4941f1d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.361204 Jun 15 15:02:54.127195 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 473/976] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:53 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:54.186862 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:54.195849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:54.197549 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:54.199367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6064e42b-49a3-42e4-ac8e-9d97309fe62c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1721 microversion: 2.20 time: 0.240488 Jun 15 15:02:54.200194 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 504/977] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:53 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:02:55.145076 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:55.145688 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:55.152925 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:55.153372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:55.154134 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:55.154596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:55.218763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:55.219485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:55.226471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:55.226929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:55.227704 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:55.228176 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:55.320887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:55.320887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-414f10d2-d3b9-4fac-bcd1-1fd8aa9aaae9 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1576 microversion: 2.1 time: 0.178550 Jun 15 15:02:55.320887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 474/978] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:55 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:55.387778 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:55.395745 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:55.397291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:55.398723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f28135f8-23b4-4099-86f1-35650d25a016 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1721 microversion: 2.20 time: 0.183902 Jun 15 15:02:55.399282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 505/979] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:55 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:02:56.341210 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:56.341822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:56.348609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.349060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.349827 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.350296 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.416974 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:56.417566 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:56.424140 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.424603 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.425380 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.425829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.512891 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:56.520510 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-16dba296-6c4a-4b39-ab8e-a0c77106b62d tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1563 microversion: 2.1 time: 0.183258 Jun 15 15:02:56.521161 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 475/980] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:02:56 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:02:56.596834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:56.605436 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:56.607078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:56.608240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e2bc5423-4eeb-420f-a415-9cefeb6826a6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1721 microversion: 2.20 time: 0.195272 Jun 15 15:02:56.608844 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 506/981] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:56 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:02:56.862449 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-162da79b-b934-404d-b14a-2d3e2ea37b59 req-995e9104-1ea3-48f3-b11b-3547742828d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1", "name": "network-vif-unplugged", "status": "completed", "tag": "3c15b40b-3126-4ab0-8e3c-b2ed2188737c"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:02:56.883261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-162da79b-b934-404d-b14a-2d3e2ea37b59 req-995e9104-1ea3-48f3-b11b-3547742828d2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:56.883440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-162da79b-b934-404d-b14a-2d3e2ea37b59 req-995e9104-1ea3-48f3-b11b-3547742828d2 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:56.896148 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-162da79b-b934-404d-b14a-2d3e2ea37b59 req-995e9104-1ea3-48f3-b11b-3547742828d2 service nova] Creating event network-vif-unplugged:3c15b40b-3126-4ab0-8e3c-b2ed2188737c for instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 on hv-cinder-84517 Jun 15 15:02:56.901498 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-162da79b-b934-404d-b14a-2d3e2ea37b59 req-995e9104-1ea3-48f3-b11b-3547742828d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042700 Jun 15 15:02:56.907337 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 476/982] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:02:57.627880 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:57.628706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:57.636121 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:57.636616 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:57.637377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:57.637983 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:57.765600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:57.774559 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:57.776068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:57.777214 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9ade79db-4dfe-4078-ab1a-7bd7b0695634 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1721 microversion: 2.20 time: 0.153711 Jun 15 15:02:57.777779 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 507/983] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:57 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:58.796369 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:58.797062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:58.803244 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:58.804535 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:58.805286 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:58.805724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:58.943168 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:58.951678 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:58.953193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:02:58.954423 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8b9a9990-ac8a-4cb8-a158-100d57cbe5a9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1721 microversion: 2.20 time: 0.162865 Jun 15 15:02:58.954981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 477/984] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:58 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:02:59.976467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:02:59.977187 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:02:59.983878 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:59.984327 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:02:59.985131 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:02:59.985547 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.117361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:00.125667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:00.127289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:00.128595 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a428a574-dc61-478f-a4cd-ca51c6b9bfe4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1724 microversion: 2.20 time: 0.156488 Jun 15 15:03:00.129154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 508/985] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:02:59 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:00.151838 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0f8256fa-99d6-441f-bc0f-3579242a29be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d22f2da8-9d69-4377-afc0-1e1ad9256227"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:00.151838 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0f8256fa-99d6-441f-bc0f-3579242a29be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:00.157561 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f8256fa-99d6-441f-bc0f-3579242a29be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.157814 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-df7d5956-f2fd-4a78-a735-acac9409d96b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:00.158023 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f8256fa-99d6-441f-bc0f-3579242a29be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.158831 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f8256fa-99d6-441f-bc0f-3579242a29be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.158997 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-df7d5956-f2fd-4a78-a735-acac9409d96b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:00.159281 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0f8256fa-99d6-441f-bc0f-3579242a29be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.165531 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7d5956-f2fd-4a78-a735-acac9409d96b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.165982 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7d5956-f2fd-4a78-a735-acac9409d96b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.166777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7d5956-f2fd-4a78-a735-acac9409d96b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.167216 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-df7d5956-f2fd-4a78-a735-acac9409d96b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.171112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:00.198359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-df7d5956-f2fd-4a78-a735-acac9409d96b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Jun 15 15:03:00.198978 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 509/986] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:00 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:00.208877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-41df23c5-c6c8-49ca-9559-79274532c4ca tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:00.209365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-41df23c5-c6c8-49ca-9559-79274532c4ca tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:00.216067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41df23c5-c6c8-49ca-9559-79274532c4ca tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.216572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41df23c5-c6c8-49ca-9559-79274532c4ca tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.217414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41df23c5-c6c8-49ca-9559-79274532c4ca tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:00.217879 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-41df23c5-c6c8-49ca-9559-79274532c4ca tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:00.251941 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-41df23c5-c6c8-49ca-9559-79274532c4ca tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/ff09296d-2952-4a6b-b2f2-6838e16e0387" status: 200 len: 194 microversion: 2.1 time: 0.046630 Jun 15 15:03:00.258015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 510/987] 10.222.0.23 () {58 vars in 1412 bytes} [Wed Jun 15 15:03:00 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/ff09296d-2952-4a6b-b2f2-6838e16e0387 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:01.355183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0f8256fa-99d6-441f-bc0f-3579242a29be tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.211153 Jun 15 15:03:01.355789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 478/988] 10.222.0.23 () {62 vars in 1363 bytes} [Wed Jun 15 15:03:00 2022] POST /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-volume_attachments => generated 188 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 15:03:01.469563 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b0eea5a8-5a59-4a19-bb7b-d0ceb8f898a4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:01.470414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b0eea5a8-5a59-4a19-bb7b-d0ceb8f898a4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:01.477259 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0eea5a8-5a59-4a19-bb7b-d0ceb8f898a4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:01.477747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0eea5a8-5a59-4a19-bb7b-d0ceb8f898a4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:01.478522 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0eea5a8-5a59-4a19-bb7b-d0ceb8f898a4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:01.478964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b0eea5a8-5a59-4a19-bb7b-d0ceb8f898a4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:01.927114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-486f5219-9211-47f6-8a41-1bb49aff9e58 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf05063-643b-4dd7-9f49-69ac9dc82d31"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:01.928199 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-486f5219-9211-47f6-8a41-1bb49aff9e58 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:01.936225 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486f5219-9211-47f6-8a41-1bb49aff9e58 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:01.936674 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486f5219-9211-47f6-8a41-1bb49aff9e58 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:01.937441 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486f5219-9211-47f6-8a41-1bb49aff9e58 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:01.937876 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-486f5219-9211-47f6-8a41-1bb49aff9e58 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:02.160508 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b0eea5a8-5a59-4a19-bb7b-d0ceb8f898a4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-volume_attachments/d22f2da8-9d69-4377-afc0-1e1ad9256227" status: 202 len: 0 microversion: 2.20 time: 0.695062 Jun 15 15:03:02.161170 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 511/989] 10.222.0.23 () {60 vars in 1456 bytes} [Wed Jun 15 15:03:01 2022] DELETE /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-volume_attachments/d22f2da8-9d69-4377-afc0-1e1ad9256227 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:03:02.217209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2ab4507c-d5c1-4444-b9fb-fee33128a793 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:02.217790 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2ab4507c-d5c1-4444-b9fb-fee33128a793 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:02.227850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2ab4507c-d5c1-4444-b9fb-fee33128a793 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:02.228301 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2ab4507c-d5c1-4444-b9fb-fee33128a793 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:02.229077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2ab4507c-d5c1-4444-b9fb-fee33128a793 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:02.229519 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2ab4507c-d5c1-4444-b9fb-fee33128a793 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:02.495277 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2ab4507c-d5c1-4444-b9fb-fee33128a793 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "POST /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/action" status: 202 len: 0 microversion: 2.20 time: 0.281976 Jun 15 15:03:02.496645 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 512/990] 10.222.0.23 () {62 vars in 1318 bytes} [Wed Jun 15 15:03:02 2022] POST /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:03:02.504676 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:02.505420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:02.511786 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:02.512237 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:02.513006 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:02.513488 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:02.649928 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:02.658354 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:02.659850 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:02.660998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d49cb10c-29e9-4c02-aeb0-519be37e370a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1672 microversion: 2.20 time: 0.160180 Jun 15 15:03:02.661949 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 513/991] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:02 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:02.953796 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-486f5219-9211-47f6-8a41-1bb49aff9e58 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "POST /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030075 Jun 15 15:03:02.954597 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 479/992] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 15:03:01 2022] POST /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:03:03.688959 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:03.689570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:03.696457 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:03.696908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:03.714868 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:03.714868 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:03.715111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-08ca65c6-dd26-40b6-b411-11cdc3eac770 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:03.715111 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-08ca65c6-dd26-40b6-b411-11cdc3eac770 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:03.715333 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08ca65c6-dd26-40b6-b411-11cdc3eac770 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:03.715734 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08ca65c6-dd26-40b6-b411-11cdc3eac770 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:03.716502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08ca65c6-dd26-40b6-b411-11cdc3eac770 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:03.716947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-08ca65c6-dd26-40b6-b411-11cdc3eac770 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:03.742383 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-08ca65c6-dd26-40b6-b411-11cdc3eac770 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/ips" status: 200 len: 150 microversion: 2.1 time: 0.038520 Jun 15 15:03:03.743025 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 480/993] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 15:03:03 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:03:03.829253 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:03.837679 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:03.839213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:03.840429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a3667c61-9db3-485b-a318-95fcec6a2c7a tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1672 microversion: 2.20 time: 0.155456 Jun 15 15:03:03.840987 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 514/994] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:03 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:04.859794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:04.860332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:04.867702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:04.868156 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:04.869058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:04.869501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:05.018096 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:05.026261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:05.027875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:05.031976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ca223b77-a0d2-4e14-a11a-d88a0ad391a3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.174268 Jun 15 15:03:05.032554 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 481/995] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:04 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:06.061977 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:06.062621 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:06.065105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=62 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:06.070457 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:06.070915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:06.071691 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:06.072135 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:06.198052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:06.205982 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:06.207522 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:06.208679 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3cdd50a2-fd11-4ed9-80a1-3c8ccdcb34fc tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.150625 Jun 15 15:03:06.209244 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 515/996] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:06 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:07.227764 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:07.228357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:07.235114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:07.235550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:07.236318 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:07.236756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:07.374367 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:07.382232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:07.384260 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:07.385411 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6a018bcc-d773-41b3-b7ae-c43d534190d6 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.162307 Jun 15 15:03:07.385959 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 482/997] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:07 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:08.403684 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:08.404303 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:08.410847 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:08.411303 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:08.412077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:08.412520 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:08.622730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:08.630597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:08.637128 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:08.637128 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-84fc83ac-7f67-45b1-b060-6790b2d51042 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.233550 Jun 15 15:03:08.637128 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 516/998] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:08 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:09.653275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:09.654822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:09.665555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:09.673735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:09.673735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:09.673735 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:09.832752 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:09.854704 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:09.856383 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:09.857650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-41676fe4-de1d-4506-b7da-afbb24ec6cab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.209219 Jun 15 15:03:09.858422 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 483/999] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:09 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:10.215640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2345f290-41da-4054-8903-ac49dda398e9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b34fb61c-b5c8-4876-8668-b1a9b9dd6536"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:10.217426 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2345f290-41da-4054-8903-ac49dda398e9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:10.225095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2345f290-41da-4054-8903-ac49dda398e9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:10.225635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2345f290-41da-4054-8903-ac49dda398e9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:10.226459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2345f290-41da-4054-8903-ac49dda398e9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:10.226901 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2345f290-41da-4054-8903-ac49dda398e9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:10.880289 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:10.881543 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:10.890567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:10.891095 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:10.891948 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:10.892783 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:11.075763 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:11.095313 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:11.098054 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:11.100232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-be1994b9-4632-4592-809d-2891c81cf613 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.223949 Jun 15 15:03:11.101415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 484/1000] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:10 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:12.119695 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:12.120447 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:12.128075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:12.128531 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:12.129316 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:12.129760 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:12.299659 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:12.301974 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:12.309738 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:12.311574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:12.312845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-eb1f4692-856d-46b1-897d-2e749791f7d3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.197255 Jun 15 15:03:12.313406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 485/1001] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:12 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:13.332791 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:13.333691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:13.341861 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:13.342343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:13.343118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:13.343558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:13.520661 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:13.536912 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:13.538717 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:13.542480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-476ca003-8c1a-4984-a9d8-5ecfb8ded4bd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.214631 Jun 15 15:03:13.558414 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 486/1002] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:13 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:14.562013 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:14.563544 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:14.571456 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:14.572310 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:14.573341 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:14.573968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:14.760461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:14.770872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:14.773018 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:14.784387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2dfdd2fe-ccba-4767-a57c-a71b8eaad438 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.226495 Jun 15 15:03:14.785146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 487/1003] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:14 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:15.803724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:15.804389 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:15.808893 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=48 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:15.813136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:15.813931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:15.815058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:15.815743 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:15.968926 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:15.980644 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:15.983040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:15.984340 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-86ed67d0-c19b-4efc-a66f-ba91d3278175 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.185038 Jun 15 15:03:15.985489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 488/1004] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:15 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:17.003907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:17.004609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:17.011486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:17.011945 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:17.012729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:17.013461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:17.154725 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:17.162904 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:17.164962 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:17.166321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-86d0f108-cbba-4632-84f6-458b0edf18ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.166497 Jun 15 15:03:17.166877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 489/1005] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:16 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:18.184749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:18.185456 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:18.191977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:18.197195 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:18.197195 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:18.197195 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:18.334499 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:18.343304 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:18.345057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:18.346277 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-637f15cd-b28a-4d5c-b677-fb20b8075567 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.165474 Jun 15 15:03:18.346832 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 490/1006] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:18 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:19.364713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:19.365312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:19.372200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:19.372660 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:19.373423 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:19.373863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:19.503377 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:19.512381 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:19.513957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:19.515309 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-785b5854-b2f2-43be-9429-e766bff79aee tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.154492 Jun 15 15:03:19.515859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 491/1007] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:19 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:20.221972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=5 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:20.533926 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:20.534579 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:20.542333 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:20.542796 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:20.543570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:20.544022 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:20.600878 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2345f290-41da-4054-8903-ac49dda398e9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "POST /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.389096 Jun 15 15:03:20.601670 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 517/1008] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 15:03:10 2022] POST /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments => generated 194 bytes in 10391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:03:20.684163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:20.693786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:20.696562 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:20.700885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-77d1943e-48f2-48cb-96e4-accfc25342e4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.167981 Jun 15 15:03:20.700885 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 492/1009] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:20 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:21.531974 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-4c643c3c-122a-4a18-a454-f5ee657127a4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:21.531974 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-4c643c3c-122a-4a18-a454-f5ee657127a4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:21.535455 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c643c3c-122a-4a18-a454-f5ee657127a4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.535920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c643c3c-122a-4a18-a454-f5ee657127a4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.536698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c643c3c-122a-4a18-a454-f5ee657127a4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.537331 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-4c643c3c-122a-4a18-a454-f5ee657127a4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.569602 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-4c643c3c-122a-4a18-a454-f5ee657127a4 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048790 Jun 15 15:03:21.571481 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 518/1010] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:21 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:21.675165 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-41528f5e-2908-4353-9dde-7ae77aa19ade tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:21.675683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-41528f5e-2908-4353-9dde-7ae77aa19ade tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:21.682931 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41528f5e-2908-4353-9dde-7ae77aa19ade tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.683376 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41528f5e-2908-4353-9dde-7ae77aa19ade tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.684141 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41528f5e-2908-4353-9dde-7ae77aa19ade tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.684577 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-41528f5e-2908-4353-9dde-7ae77aa19ade tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.714779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-41528f5e-2908-4353-9dde-7ae77aa19ade tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/ff09296d-2952-4a6b-b2f2-6838e16e0387" status: 200 len: 194 microversion: 2.1 time: 0.043625 Jun 15 15:03:21.716045 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 493/1011] 10.222.0.23 () {58 vars in 1412 bytes} [Wed Jun 15 15:03:21 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/ff09296d-2952-4a6b-b2f2-6838e16e0387 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:21.717483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:21.718302 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:21.724474 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.724921 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.725292 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:21.725678 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.725782 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:21.726110 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.732494 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.737870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.737870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:21.737870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:21.860879 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:21.872424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:21.874043 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:21.875236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a27b7de8-0e60-4d81-ad6c-c3c49f05b9b0 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.162346 Jun 15 15:03:21.875786 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 519/1012] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:21 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:21.964110 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lazy-loading 'services' on Instance uuid 98936448-9213-42cd-9aae-cd8fd5cd756c {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:03:22.182906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0b1564ea-f6cf-47f4-bfd5-16590cfe3a2d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/ff09296d-2952-4a6b-b2f2-6838e16e0387" status: 202 len: 0 microversion: 2.1 time: 0.461334 Jun 15 15:03:22.183496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 494/1013] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:03:21 2022] DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/ff09296d-2952-4a6b-b2f2-6838e16e0387 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:03:22.894578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:22.897209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:22.901756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:22.902230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:22.903821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:22.904078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:23.049777 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:23.056419 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:23.060866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-519cb099-77ca-4646-896f-ec01bbbb048c req-1425d510-1ba7-476f-899c-208b0b65e366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1", "name": "network-vif-plugged", "status": "completed", "tag": "3c15b40b-3126-4ab0-8e3c-b2ed2188737c"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:23.074863 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:23.074863 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:23.074863 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-844112b3-1308-41ec-80e3-e1cee462e519 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.177015 Jun 15 15:03:23.075190 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 520/1014] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:22 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:23.075964 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-519cb099-77ca-4646-896f-ec01bbbb048c req-1425d510-1ba7-476f-899c-208b0b65e366 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:23.076412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-519cb099-77ca-4646-896f-ec01bbbb048c req-1425d510-1ba7-476f-899c-208b0b65e366 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:23.088938 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-519cb099-77ca-4646-896f-ec01bbbb048c req-1425d510-1ba7-476f-899c-208b0b65e366 service nova] Creating event network-vif-plugged:3c15b40b-3126-4ab0-8e3c-b2ed2188737c for instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 on hv-cinder-84517 Jun 15 15:03:23.094070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-519cb099-77ca-4646-896f-ec01bbbb048c req-1425d510-1ba7-476f-899c-208b0b65e366 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046001 Jun 15 15:03:23.094991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 495/1015] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:24.091760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:24.092367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:24.099415 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:24.099861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:24.100621 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:24.101055 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:24.230702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:24.238981 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:24.240511 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:24.241668 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-232def21-c8d8-4d06-9a5a-0a6e7eff5dc4 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.155151 Jun 15 15:03:24.242249 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 521/1016] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:24 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:25.261214 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:25.262742 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:25.269009 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:25.269533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:25.270437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:25.270874 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:25.447207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:25.456103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:25.457646 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:25.458856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9b052790-0199-46a0-9b92-45426ea3f943 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.202655 Jun 15 15:03:25.459402 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 496/1017] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:25 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:26.477178 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:26.477856 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:26.485024 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:26.485470 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:26.486266 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:26.486703 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:26.630247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:26.640198 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:26.641807 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:26.643063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-305067a7-4313-4394-83ea-9f7207d14a10 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1730 microversion: 2.20 time: 0.169753 Jun 15 15:03:26.643661 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 522/1018] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:26 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:03:27.662030 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:27.665321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:27.669817 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:27.670299 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:27.671074 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:27.671513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:27.809516 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:27.821977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:27.827458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:27.827458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ba7c8d30-9c1c-477a-b7b7-bb957e5d731c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1717 microversion: 2.20 time: 0.166911 Jun 15 15:03:27.827458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 497/1019] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:03:27 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:03:29.523714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:29.525590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:29.536512 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:29.536512 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:29.536512 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:29.537648 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:29.642941 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'services' on Instance uuid 158292c6-a464-41ff-bbc2-3c3abe512dbd {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:03:29.940658 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-43344f8e-f62c-4b4d-9599-269455a62f69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments/b34fb61c-b5c8-4876-8668-b1a9b9dd6536" status: 202 len: 0 microversion: 2.1 time: 0.421252 Jun 15 15:03:29.942147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 523/1020] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:03:29 2022] DELETE /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments/b34fb61c-b5c8-4876-8668-b1a9b9dd6536 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:03:29.951136 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-33e3b91a-a7c1-4b6f-baab-20ed9e85e1c3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:29.952601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-33e3b91a-a7c1-4b6f-baab-20ed9e85e1c3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:29.959315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33e3b91a-a7c1-4b6f-baab-20ed9e85e1c3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:29.960007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33e3b91a-a7c1-4b6f-baab-20ed9e85e1c3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:29.967021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33e3b91a-a7c1-4b6f-baab-20ed9e85e1c3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:29.967693 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-33e3b91a-a7c1-4b6f-baab-20ed9e85e1c3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.001900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-33e3b91a-a7c1-4b6f-baab-20ed9e85e1c3 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055465 Jun 15 15:03:30.002810 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 498/1021] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:29 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:30.723106 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-de89925b-7a0f-49c2-8925-b202cff3a188 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:30.723742 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-de89925b-7a0f-49c2-8925-b202cff3a188 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:30.731921 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-de89925b-7a0f-49c2-8925-b202cff3a188 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:30.732403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-de89925b-7a0f-49c2-8925-b202cff3a188 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.733192 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-de89925b-7a0f-49c2-8925-b202cff3a188 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:30.733630 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-de89925b-7a0f-49c2-8925-b202cff3a188 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.767271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-de89925b-7a0f-49c2-8925-b202cff3a188 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/fcf05063-643b-4dd7-9f49-69ac9dc82d31" status: 200 len: 194 microversion: 2.1 time: 0.048688 Jun 15 15:03:30.767888 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 524/1022] 10.222.0.23 () {58 vars in 1412 bytes} [Wed Jun 15 15:03:30 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/fcf05063-643b-4dd7-9f49-69ac9dc82d31 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:30.779922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:30.780977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:30.787210 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:30.787669 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.788446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:30.789097 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:30.883206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lazy-loading 'services' on Instance uuid 98936448-9213-42cd-9aae-cd8fd5cd756c {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:03:31.013236 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9dc6b73c-20f7-4b96-aaa7-d686a05d6ac7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:31.014600 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9dc6b73c-20f7-4b96-aaa7-d686a05d6ac7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:31.020839 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dc6b73c-20f7-4b96-aaa7-d686a05d6ac7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:31.027532 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dc6b73c-20f7-4b96-aaa7-d686a05d6ac7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:31.027532 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dc6b73c-20f7-4b96-aaa7-d686a05d6ac7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:31.027532 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9dc6b73c-20f7-4b96-aaa7-d686a05d6ac7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:31.055384 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9dc6b73c-20f7-4b96-aaa7-d686a05d6ac7 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Jun 15 15:03:31.056463 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 525/1023] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:31 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:03:31.216708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d6a5ecbf-9800-4e86-8762-c0a485665de8 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/fcf05063-643b-4dd7-9f49-69ac9dc82d31" status: 202 len: 0 microversion: 2.1 time: 0.436529 Jun 15 15:03:31.216708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 499/1024] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:03:30 2022] DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments/fcf05063-643b-4dd7-9f49-69ac9dc82d31 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:03:32.069304 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c5042db5-4ad4-422c-9c8b-39c7556a5181 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:32.071316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c5042db5-4ad4-422c-9c8b-39c7556a5181 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:32.082338 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5042db5-4ad4-422c-9c8b-39c7556a5181 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.083641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5042db5-4ad4-422c-9c8b-39c7556a5181 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.084446 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5042db5-4ad4-422c-9c8b-39c7556a5181 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.084894 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c5042db5-4ad4-422c-9c8b-39c7556a5181 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.128435 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c5042db5-4ad4-422c-9c8b-39c7556a5181 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064955 Jun 15 15:03:32.134819 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 526/1025] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:32 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:03:32.212548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:32.213189 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:32.223149 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.224439 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.225455 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.226146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.260769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:03:32.313035 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:32.635349 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cb3f6631-0f07-484c-b367-90c26f7bbb57 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 204 len: 0 microversion: 2.1 time: 0.427780 Jun 15 15:03:32.638704 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 500/1026] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:32 2022] DELETE /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:03:32.644275 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:32.645044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:32.651705 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.652721 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.653529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:32.653970 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:32.805328 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:32.814104 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ea92bd24-bf06-41f9-8bae-6d4538c7a9d9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1680 microversion: 2.1 time: 0.173706 Jun 15 15:03:32.815154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 527/1027] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:32 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:33.491414 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c72f02d5-678c-4871-8b78-e7d933dcd371 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:33.492425 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c72f02d5-678c-4871-8b78-e7d933dcd371 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:33.500675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c72f02d5-678c-4871-8b78-e7d933dcd371 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.501131 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c72f02d5-678c-4871-8b78-e7d933dcd371 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.501907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c72f02d5-678c-4871-8b78-e7d933dcd371 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.502462 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c72f02d5-678c-4871-8b78-e7d933dcd371 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.539209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c72f02d5-678c-4871-8b78-e7d933dcd371 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058769 Jun 15 15:03:33.540101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 501/1028] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:33 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:33.831711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:33.832559 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:33.841614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.842231 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.843418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:33.844078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:33.982108 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:33.989684 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-18ddf304-6d8c-46b9-9768-8b35b40a7165 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1680 microversion: 2.1 time: 0.162191 Jun 15 15:03:33.990266 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 528/1029] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:33 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:34.551521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-131b3508-4dc7-469e-a22c-af5b8680818e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:34.552500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-131b3508-4dc7-469e-a22c-af5b8680818e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:34.560390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-131b3508-4dc7-469e-a22c-af5b8680818e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.561088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-131b3508-4dc7-469e-a22c-af5b8680818e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.562128 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-131b3508-4dc7-469e-a22c-af5b8680818e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.562738 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-131b3508-4dc7-469e-a22c-af5b8680818e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.597541 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-131b3508-4dc7-469e-a22c-af5b8680818e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049840 Jun 15 15:03:34.599694 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 502/1030] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:34 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:03:34.711159 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-11e72b7f-9609-4fa3-a188-5af9c953d01d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:34.712082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-11e72b7f-9609-4fa3-a188-5af9c953d01d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:34.718908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11e72b7f-9609-4fa3-a188-5af9c953d01d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.720276 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11e72b7f-9609-4fa3-a188-5af9c953d01d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.721454 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11e72b7f-9609-4fa3-a188-5af9c953d01d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.722028 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-11e72b7f-9609-4fa3-a188-5af9c953d01d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.768217 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-11e72b7f-9609-4fa3-a188-5af9c953d01d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060903 Jun 15 15:03:34.769334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 529/1031] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:03:34 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:03:34.855112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:34.855727 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:34.862605 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.863206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.864121 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:34.864833 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:34.905952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:03:35.006138 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:35.007612 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:35.029080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:35.029541 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:35.033665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:35.035614 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:35.278098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3064adb1-0612-4a53-b675-ffe711cf68d3 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 204 len: 0 microversion: 2.1 time: 0.428976 Jun 15 15:03:35.280812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 503/1032] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:34 2022] DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:03:35.294790 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:35.297205 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:35.307415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:35.309197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:35.310504 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:35.311214 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:35.344375 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:35.359292 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-428dabd2-4751-48fe-a1fa-518aa743fc94 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1680 microversion: 2.1 time: 0.357037 Jun 15 15:03:35.360994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 530/1033] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:35 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1680 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:03:35.778021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:35.791971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-149e793e-c92b-4438-9d4c-dff870a3df68 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1672 microversion: 2.1 time: 0.506305 Jun 15 15:03:35.793224 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 504/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:35 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1672 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:36.379835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:36.381027 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:36.390665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:36.391284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:36.392225 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:36.392837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:36.437603 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-f03c26ea-b8c4-4829-ac93-f4c444144338 req-a1bd9663-8862-4e22-877b-e3a1526b0494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158292c6-a464-41ff-bbc2-3c3abe512dbd", "name": "network-vif-deleted", "tag": "4401ae77-69bf-41f6-bd33-dc46fb458512"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:36.446315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f03c26ea-b8c4-4829-ac93-f4c444144338 req-a1bd9663-8862-4e22-877b-e3a1526b0494 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:36.447007 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f03c26ea-b8c4-4829-ac93-f4c444144338 req-a1bd9663-8862-4e22-877b-e3a1526b0494 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:36.469326 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-f03c26ea-b8c4-4829-ac93-f4c444144338 req-a1bd9663-8862-4e22-877b-e3a1526b0494 service nova] Creating event network-vif-deleted:4401ae77-69bf-41f6-bd33-dc46fb458512 for instance 158292c6-a464-41ff-bbc2-3c3abe512dbd on hv-cinder-84517 Jun 15 15:03:36.486201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-f03c26ea-b8c4-4829-ac93-f4c444144338 req-a1bd9663-8862-4e22-877b-e3a1526b0494 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052694 Jun 15 15:03:36.492922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 505/1035] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:36.505304 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:36.516295 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-efb2d53b-72c7-429a-9f4e-0792179a95b9 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1613 microversion: 2.1 time: 0.142541 Jun 15 15:03:36.517498 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 531/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:36 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1613 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:36.810996 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:36.811552 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:36.822088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:36.822838 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:36.823369 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:36.823850 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:37.062086 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:37.074645 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-867770bd-b0fb-4e7b-82d7-bc3daa35153c tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1672 microversion: 2.1 time: 0.268018 Jun 15 15:03:37.075758 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 506/1037] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:36 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:37.540353 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:37.542420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:37.551150 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:37.552131 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:37.553330 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:37.553812 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:37.675068 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:37.683521 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-428754f3-172b-421e-8aca-5c0e3e870512 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1325 microversion: 2.1 time: 0.151832 Jun 15 15:03:37.684110 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 532/1038] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:37 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:03:38.095411 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:38.100273 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:38.106314 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.107702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.109671 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.110404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.357437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:38.371444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6824628b-a699-4a84-8fc9-0275e8b4ee61 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1672 microversion: 2.1 time: 0.281382 Jun 15 15:03:38.373896 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 507/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:38 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:38.702084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:38.702744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:38.711448 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.713761 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.714973 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.717146 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.785505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:38.786156 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:38.786798 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lazy-loading 'fault' on Instance uuid 158292c6-a464-41ff-bbc2-3c3abe512dbd {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:03:38.848569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e367e391e68a477d861a515f846a8dfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c100074063c44d96adf93e0b0f080527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:38.860558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7ae16856-d151-411d-a065-2000a6cad382 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 200 len: 1330 microversion: 2.1 time: 0.163024 Jun 15 15:03:38.861610 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 533/1040] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:38 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 1330 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:39.319141 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-549ba859-ace4-4526-a911-ceefc46f45bd req-3ff15ebf-dd30-4b23-a586-c7d8935b0c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98936448-9213-42cd-9aae-cd8fd5cd756c", "name": "network-vif-deleted", "tag": "df81f8c2-6abf-4f53-9203-841bf57a88f9"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:39.333298 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-549ba859-ace4-4526-a911-ceefc46f45bd req-3ff15ebf-dd30-4b23-a586-c7d8935b0c16 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.333987 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-549ba859-ace4-4526-a911-ceefc46f45bd req-3ff15ebf-dd30-4b23-a586-c7d8935b0c16 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.348845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-549ba859-ace4-4526-a911-ceefc46f45bd req-3ff15ebf-dd30-4b23-a586-c7d8935b0c16 service nova] Creating event network-vif-deleted:df81f8c2-6abf-4f53-9203-841bf57a88f9 for instance 98936448-9213-42cd-9aae-cd8fd5cd756c on hv-cinder-84517 Jun 15 15:03:39.356989 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-549ba859-ace4-4526-a911-ceefc46f45bd req-3ff15ebf-dd30-4b23-a586-c7d8935b0c16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043815 Jun 15 15:03:39.364781 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 508/1041] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:39.397404 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:39.406847 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:39.423689 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.424911 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.425906 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.426540 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.506553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:39.516869 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-073a31b1-4b02-48f4-8fc9-662ff81ae617 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1605 microversion: 2.1 time: 0.130499 Jun 15 15:03:39.529534 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 534/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:39 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:39.880845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:39.881677 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:39.890074 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.890843 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.898536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:39.898536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:39.910070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd HTTP/1.1 Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:03:39.911981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:39.913609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '158292c6-a464-41ff-bbc2-3c3abe512dbd'} Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:39.914432 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:39.917204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:39.919648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:39.919648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-789bc733-6862-46da-81d7-4b5cf5a87d69 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 404 len: 111 microversion: 2.1 time: 0.040267 Jun 15 15:03:39.924276 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0c06d136-5eed-47e8-ad62-5f73776a72e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '.version_select at 0x7f693a5764c0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:39.932340 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 509/1043] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:39 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:40.076258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0c06d136-5eed-47e8-ad62-5f73776a72e8 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970729002" status: 202 len: 0 microversion: 2.1 time: 0.156644 Jun 15 15:03:40.076851 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 535/1044] 10.222.0.23 () {58 vars in 1217 bytes} [Wed Jun 15 15:03:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970729002 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:03:40.536917 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:40.538062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:40.555721 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.557414 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.558481 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.558923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.606534 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:40.606900 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:40.607350 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lazy-loading 'fault' on Instance uuid 98936448-9213-42cd-9aae-cd8fd5cd756c {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:03:40.681533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df400aee39a3498d8a26d55180075ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae6c02cace9481d9b87e8f9d61323c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:40.690498 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-60891232-c87b-49c8-81a4-f66dc16ac7b9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 200 len: 1326 microversion: 2.1 time: 0.158058 Jun 15 15:03:40.691618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 510/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:40 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:41.708572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:41.709164 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:41.715957 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:41.716414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:41.717291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:41.717669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:41.733681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] HTTP exception thrown: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Request method failure captured: Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c HTTP/1.1 Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL4plesDMsf4o_eg0lBkxHpqcDFAJAFvkpgOuPn4ZOXYdbwNbWMNIwQBdxlPdltSwKbsysUDuX1RW7GRzbNZg0QVAEpBQpXN5dbFPNALduGGvx67YW8UqzfmRWaSZ5MgI4-fskW5LeBzetqPeCVlAllV7dfgzZnXPxzn_0hTF3wvkM Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:03:41.735722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: df400aee39a3498d8a26d55180075ab6 Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:41.737069 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '98936448-9213-42cd-9aae-cd8fd5cd756c'} Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:41.737815 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:41.739048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:41.740133 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Returning 404 to user: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:41.740133 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-be929cd7-1d00-460a-a3c9-7c3d48780d76 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 404 len: 111 microversion: 2.1 time: 0.033052 Jun 15 15:03:41.740133 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 536/1046] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:41 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:41.748075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dbbf6c86-348f-4113-b16e-8d2c54d8a6a9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '.version_select at 0x7f693abcc940>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:41.881859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dbbf6c86-348f-4113-b16e-8d2c54d8a6a9 tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-471361055" status: 202 len: 0 microversion: 2.1 time: 0.139357 Jun 15 15:03:41.882473 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 511/1047] 10.222.0.23 () {58 vars in 1217 bytes} [Wed Jun 15 15:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-471361055 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:03:42.536165 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:42.536918 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:42.543961 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.544756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.546058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.546816 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.563115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd HTTP/1.1 Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:03:42.570360 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.572034 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '158292c6-a464-41ff-bbc2-3c3abe512dbd'} Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:42.572952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.576875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.579574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:42.579574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d90ad2bf-f5c8-490e-98cc-89342c3e6b8d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 404 len: 111 microversion: 2.1 time: 0.034980 Jun 15 15:03:42.579574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 537/1048] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:42 2022] DELETE /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:42.580057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:42.580057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 158292c6-a464-41ff-bbc2-3c3abe512dbd] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:42.583342 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.583805 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.584867 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:42.585036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:42.605976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd HTTP/1.1 Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:03:42.607471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.616265 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '158292c6-a464-41ff-bbc2-3c3abe512dbd'} Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:42.617151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. Jun 15 15:03:42.619240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:42.620822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 158292c6-a464-41ff-bbc2-3c3abe512dbd could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:42.620822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-31e1779e-1262-4961-ac47-ee5b10662051 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd" status: 404 len: 111 microversion: 2.1 time: 0.037813 Jun 15 15:03:42.620822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 512/1049] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:42 2022] GET /compute/v2.1/servers/158292c6-a464-41ff-bbc2-3c3abe512dbd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:43.958945 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:43.964361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:43.970706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:43.971434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:43.972381 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:43.972989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:43.998258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 HTTP/1.1 Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:03:44.001365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.003079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '213535cc-ae46-43b2-ad12-f49fc89e13b2'} Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:44.003976 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.005428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.006882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:44.014139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0dfd5c86-17cc-487e-b2f9-06bb95e2495d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 404 len: 111 microversion: 2.1 time: 0.046375 Jun 15 15:03:44.014825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 538/1050] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:43 2022] DELETE /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:44.026125 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:44.028033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 213535cc-ae46-43b2-ad12-f49fc89e13b2] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:44.035759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:44.036217 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:44.038011 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:44.038011 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:44.055536 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 HTTP/1.1 Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:03:44.058135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.066070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '213535cc-ae46-43b2-ad12-f49fc89e13b2'} Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:44.066991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. Jun 15 15:03:44.068182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.069245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 213535cc-ae46-43b2-ad12-f49fc89e13b2 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:44.069245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-fe0dc38a-d07b-4d85-a802-29695e36d26b tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2" status: 404 len: 111 microversion: 2.1 time: 0.040793 Jun 15 15:03:44.069245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 513/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:44 2022] GET /compute/v2.1/servers/213535cc-ae46-43b2-ad12-f49fc89e13b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:44.076249 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:44.076763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:44.087457 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:44.087903 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:44.088698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:44.089803 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:44.107505 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 HTTP/1.1 Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:03:44.108990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.110620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '4db8069f-14f9-458c-984e-4c7e3ea32df0'} Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:44.111429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.112979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.115530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:44.115530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-74803912-99e9-419f-8d89-34ed2566ad1d tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 404 len: 111 microversion: 2.1 time: 0.039437 Jun 15 15:03:44.118947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:44.119568 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: 4db8069f-14f9-458c-984e-4c7e3ea32df0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:44.124595 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 539/1052] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:44 2022] DELETE /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:44.126335 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:44.127294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:44.128315 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:44.128978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:44.144789 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 HTTP/1.1 Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:03:44.146490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.147863 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '4db8069f-14f9-458c-984e-4c7e3ea32df0'} Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:44.148637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. Jun 15 15:03:44.149944 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:44.157708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance 4db8069f-14f9-458c-984e-4c7e3ea32df0 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:44.157708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6e34f356-3cec-4497-9ef6-e6d3961e1cdf tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0" status: 404 len: 111 microversion: 2.1 time: 0.032837 Jun 15 15:03:44.157708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 514/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:44 2022] GET /compute/v2.1/servers/4db8069f-14f9-458c-984e-4c7e3ea32df0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:45.814306 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:45.815439 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:45.828240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.830741 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.834890 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.835624 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.842744 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:45.853393 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d HTTP/1.1 Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:03:45.855784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.857502 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'ba5993ec-f833-475c-8ea7-16536586674d'} Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:45.858492 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.860132 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.861654 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:45.861654 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2d020d9e-5b58-47df-ab2d-5d0f7632c8ec tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 404 len: 111 microversion: 2.1 time: 0.047124 Jun 15 15:03:45.861654 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 540/1054] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:45 2022] DELETE /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:45.868311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:45.869153 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] [instance: ba5993ec-f833-475c-8ea7-16536586674d] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:45.875758 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:45.889533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.892324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.893373 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.895982 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.918724 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:45.919234 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:45.925941 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.926435 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.927736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.928348 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.930881 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] HTTP exception thrown: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Request method failure captured: Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d HTTP/1.1 Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfMA_nsXjCpQKuxj3QYWrE4W-qG3MEBK-lAJxKulxk-_TvggwxAoTMbVIYsIqaO-Cik_LIRfAWvSXCYnI_dw0GuNwnajnZMLyROeLfPj3BKrfTdzpILY8QXL9P_1F5yJvsf4KMFNObwf1X_TvrYMuEFaggvcD7SZY5zNTQla0J9SHDg Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:03:45.939206 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c100074063c44d96adf93e0b0f080527"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c100074063c44d96adf93e0b0f080527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c100074063c44d96adf93e0b0f080527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: c100074063c44d96adf93e0b0f080527 Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1920299639 Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: e367e391e68a477d861a515f846a8dfa Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeNegativeTest-1920299639-project Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.940968 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'ba5993ec-f833-475c-8ea7-16536586674d'} Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:45.941875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. Jun 15 15:03:45.943630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.945101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] Returning 404 to user: Instance ba5993ec-f833-475c-8ea7-16536586674d could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:45.945101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-42721774-1edc-4dad-85be-b6c079e98d13 tempest-AttachVolumeNegativeTest-1920299639 tempest-AttachVolumeNegativeTest-1920299639-project] 10.222.0.23 "GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d" status: 404 len: 111 microversion: 2.1 time: 0.079811 Jun 15 15:03:45.945820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] HTTP exception thrown: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Request method failure captured: Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c HTTP/1.1 Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL4plesDMsf4o_eg0lBkxHpqcDFAJAFvkpgOuPn4ZOXYdbwNbWMNIwQBdxlPdltSwKbsysUDuX1RW7GRzbNZg0QVAEpBQpXN5dbFPNALduGGvx67YW8UqzfmRWaSZ5MgI4-fskW5LeBzetqPeCVlAllV7dfgzZnXPxzn_0hTF3wvkM Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:03:45.947623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: df400aee39a3498d8a26d55180075ab6 Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:45.949631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '98936448-9213-42cd-9aae-cd8fd5cd756c'} Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:45.951017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:45.952886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:45.954354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 515/1055] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:45 2022] GET /compute/v2.1/servers/ba5993ec-f833-475c-8ea7-16536586674d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:45.954459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Returning 404 to user: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:45.954459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e7d2f1e0-aec0-43ef-92fd-72b5205dfb4d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 404 len: 111 microversion: 2.1 time: 0.037673 Jun 15 15:03:45.954459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 541/1056] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:45 2022] DELETE /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:03:45.969977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:45.970664 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 98936448-9213-42cd-9aae-cd8fd5cd756c] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:45.977608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.980448 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:45.983040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:45.983565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:46.015379 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] HTTP exception thrown: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Request method failure captured: Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c HTTP/1.1 Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfL4plesDMsf4o_eg0lBkxHpqcDFAJAFvkpgOuPn4ZOXYdbwNbWMNIwQBdxlPdltSwKbsysUDuX1RW7GRzbNZg0QVAEpBQpXN5dbFPNALduGGvx67YW8UqzfmRWaSZ5MgI4-fskW5LeBzetqPeCVlAllV7dfgzZnXPxzn_0hTF3wvkM Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:03:46.019744 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: df400aee39a3498d8a26d55180075ab6 Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:46.021866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '98936448-9213-42cd-9aae-cd8fd5cd756c'} Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:46.022774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. Jun 15 15:03:46.024255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:46.027253 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Returning 404 to user: Instance 98936448-9213-42cd-9aae-cd8fd5cd756c could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:46.031725 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ecddd509-ae20-435a-a342-9b3820e6704d tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c" status: 404 len: 111 microversion: 2.1 time: 0.073497 Jun 15 15:03:46.031725 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 516/1057] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:45 2022] GET /compute/v2.1/servers/98936448-9213-42cd-9aae-cd8fd5cd756c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:47.501720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:47.502250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:47.519064 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:47.520714 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:47.521044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:47.522067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:47.548994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] HTTP exception thrown: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Request method failure captured: Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec HTTP/1.1 Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL4plesDMsf4o_eg0lBkxHpqcDFAJAFvkpgOuPn4ZOXYdbwNbWMNIwQBdxlPdltSwKbsysUDuX1RW7GRzbNZg0QVAEpBQpXN5dbFPNALduGGvx67YW8UqzfmRWaSZ5MgI4-fskW5LeBzetqPeCVlAllV7dfgzZnXPxzn_0hTF3wvkM Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:03:47.551245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: df400aee39a3498d8a26d55180075ab6 Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.552829 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '97c39abd-c1c7-443f-802e-a65f0e0888ec'} Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:47.553715 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.555200 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.557913 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Returning 404 to user: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:47.561646 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0612946b-acde-4111-bd2f-6281dd27a72b tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "DELETE /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 404 len: 111 microversion: 2.1 time: 0.064689 Jun 15 15:03:47.564232 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 542/1058] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:03:47 2022] DELETE /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:47.571923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:47.572555 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] [instance: 97c39abd-c1c7-443f-802e-a65f0e0888ec] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:47.581653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:47.582107 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:47.583130 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:47.585269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:47.616767 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] HTTP exception thrown: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Request method failure captured: Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec HTTP/1.1 Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfL4plesDMsf4o_eg0lBkxHpqcDFAJAFvkpgOuPn4ZOXYdbwNbWMNIwQBdxlPdltSwKbsysUDuX1RW7GRzbNZg0QVAEpBQpXN5dbFPNALduGGvx67YW8UqzfmRWaSZ5MgI4-fskW5LeBzetqPeCVlAllV7dfgzZnXPxzn_0hTF3wvkM Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:03:47.618732 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ae6c02cace9481d9b87e8f9d61323c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 3ae6c02cace9481d9b87e8f9d61323c3 Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeTestJSON-563223740 Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: df400aee39a3498d8a26d55180075ab6 Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeTestJSON-563223740-project Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.621116 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '97c39abd-c1c7-443f-802e-a65f0e0888ec'} Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:03:47.622070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. Jun 15 15:03:47.629901 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:03:47.632143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] Returning 404 to user: Instance 97c39abd-c1c7-443f-802e-a65f0e0888ec could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:03:47.632143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2d28a429-ff0f-4aaf-9017-bf2737e57d1e tempest-AttachVolumeTestJSON-563223740 tempest-AttachVolumeTestJSON-563223740-project] 10.222.0.23 "GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec" status: 404 len: 111 microversion: 2.1 time: 0.057053 Jun 15 15:03:47.632143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 517/1059] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:47 2022] GET /compute/v2.1/servers/97c39abd-c1c7-443f-802e-a65f0e0888ec => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:03:55.821665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ac4d48bd-e685-4045-9a0c-7fef5ec4886a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Action: 'create', calling method: .version_select at 0x7f693a64faf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1774682568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOm5+qX7CSVzDbLj5XD32TnBEYqn+sANUz0eWuI7sc7CnBoAXU2fNbJ0qW6KfBtuaVX205ydR7UL5IGF5FtVd7lHYVkot2vNTLmzQGOnpG5PbZAHB9ocrivDin0113xREw=="}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:55.827520 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:03:55.838530 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-ac4d48bd-e685-4045-9a0c-7fef5ec4886a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Getting quotas for project 019a9c2e2943403ab0700a96af732826. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:03:55.842539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-ac4d48bd-e685-4045-9a0c-7fef5ec4886a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Getting quotas for user 833efc71510e4bf8a5418671026a1b29 and project 019a9c2e2943403ab0700a96af732826. Resources: {'key_pairs'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:03:55.949517 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ac4d48bd-e685-4045-9a0c-7fef5ec4886a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.131724 Jun 15 15:03:55.951113 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 543/1060] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jun 15 15:03:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:56.047356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-434911563", "imageRef": "0180d438-4064-4f9b-9421-80e22bd993cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1774682568", "networks": [{"uuid": "c98ebd74-5881-4ff7-9aa9-add515c0630d"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:03:56.102694 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] validate_networks() for [('c98ebd74-5881-4ff7-9aa9-add515c0630d', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:03:56.485547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:03:56.485971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:03:56.486487 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:03:56.486902 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:03:56.487316 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:03:56.496318 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:56.496766 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:56.497558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:03:56.498097 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:03:56.540908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Getting quotas for project 019a9c2e2943403ab0700a96af732826. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:03:56.540908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Getting quotas for user 833efc71510e4bf8a5418671026a1b29 and project 019a9c2e2943403ab0700a96af732826. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:03:56.540908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:03:56.540908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0180d438-4064-4f9b-9421-80e22bd993cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:03:56.812639 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-376cf8c7-2fa2-4f38-9eb3-1c3df16c67aa tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769060 Jun 15 15:03:56.813322 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 518/1061] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:03:56.824518 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2691cc30-f6ae-4ff7-ab08-b6a836da95ee tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:56.825141 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2691cc30-f6ae-4ff7-ab08-b6a836da95ee tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:56.881302 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2691cc30-f6ae-4ff7-ab08-b6a836da95ee tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:56.891408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2691cc30-f6ae-4ff7-ab08-b6a836da95ee tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1258 microversion: 2.1 time: 0.069746 Jun 15 15:03:56.891408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 544/1062] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:56 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:57.909714 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7b5ac02f-1965-417c-85cc-078633b766a9 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:57.910366 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7b5ac02f-1965-417c-85cc-078633b766a9 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:57.967300 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7b5ac02f-1965-417c-85cc-078633b766a9 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:57.974506 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7b5ac02f-1965-417c-85cc-078633b766a9 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1258 microversion: 2.1 time: 0.070237 Jun 15 15:03:57.975068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 519/1063] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:57 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:03:58.444818 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c0b71cc0-911a-4731-92ba-6fa5d4bb858c tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693a40f310>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:58.506865 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c0b71cc0-911a-4731-92ba-6fa5d4bb858c tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/10675b84-3a60-49e7-9793-fcd666f63b1e" status: 200 len: 351 microversion: 2.1 time: 0.051629 Jun 15 15:03:58.506865 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 545/1064] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:03:58 2022] GET /compute/v2.1/os-volumes/10675b84-3a60-49e7-9793-fcd666f63b1e => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:03:58.991278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dd2e0fba-4299-4ddc-9163-86b0f08c644d tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:03:58.991887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dd2e0fba-4299-4ddc-9163-86b0f08c644d tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:03:59.044578 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dd2e0fba-4299-4ddc-9163-86b0f08c644d tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:03:59.051484 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dd2e0fba-4299-4ddc-9163-86b0f08c644d tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1258 microversion: 2.1 time: 0.064087 Jun 15 15:03:59.052048 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 520/1065] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:03:58 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:00.075994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:00.077126 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:00.084710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:00.089637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:00.089637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:00.089637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:00.152428 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:00.159877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-679ef3b1-c489-4ce7-b3da-d2cf03c5d51e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1254 microversion: 2.1 time: 0.088684 Jun 15 15:04:00.160507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 546/1066] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:00 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1254 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:00.628526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d98b0ad8-d4f3-40b0-b322-de8b512616b1 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693ac18550>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:00.683005 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d98b0ad8-d4f3-40b0-b322-de8b512616b1 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/40a8d508-013a-46a1-8686-af384b2beda6" status: 200 len: 350 microversion: 2.1 time: 0.058399 Jun 15 15:04:00.683630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 521/1067] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:04:00 2022] GET /compute/v2.1/os-volumes/40a8d508-013a-46a1-8686-af384b2beda6 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:01.178554 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:01.179165 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:01.186707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:01.187155 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:01.187909 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:01.188371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:01.279329 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:01.294022 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-75dc63d8-0b21-4252-88e9-edc2ae4e156e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1318 microversion: 2.1 time: 0.119169 Jun 15 15:04:01.298801 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 547/1068] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:01 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:02.314639 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:02.320204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:02.346500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:02.346965 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:02.347758 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:02.348182 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:02.418917 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b87ffba6-3a77-42e8-950f-ea0d56d0f2a0 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693a739d30>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:02.520784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b87ffba6-3a77-42e8-950f-ea0d56d0f2a0 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/00c161cc-9204-4c81-8032-a56189bfa3fc" status: 200 len: 351 microversion: 2.1 time: 0.105735 Jun 15 15:04:02.521348 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 548/1069] 10.222.0.23 () {58 vars in 1244 bytes} [Wed Jun 15 15:04:02 2022] GET /compute/v2.1/os-volumes/00c161cc-9204-4c81-8032-a56189bfa3fc => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:04:02.533140 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-01e85594-3cc1-4ebd-ac7d-68637ef2a7e5 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693a576dc0>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:02.620112 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-01e85594-3cc1-4ebd-ac7d-68637ef2a7e5 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090016 Jun 15 15:04:02.620939 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 549/1070] 10.222.0.23 () {58 vars in 1133 bytes} [Wed Jun 15 15:04:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:02.630883 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:02.636495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3975ef03-0e10-4869-9b77-2bf4adb77c5a tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693a2fdb80>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:02.641947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-514fbf1b-ff0d-4d3b-9dac-69991e2e78e5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.332057 Jun 15 15:04:02.644580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 522/1071] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:02 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:02.788950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3975ef03-0e10-4869-9b77-2bf4adb77c5a tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157613 Jun 15 15:04:02.805567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a5748307-44cc-4b4a-8f70-de82308841d4 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693aca9550>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:02.806218 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 550/1072] 10.222.0.23 () {58 vars in 1148 bytes} [Wed Jun 15 15:04:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:02.921688 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a5748307-44cc-4b4a-8f70-de82308841d4 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.119881 Jun 15 15:04:02.934343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 523/1073] 10.222.0.23 () {58 vars in 1133 bytes} [Wed Jun 15 15:04:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:02.936791 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a49edadc-c920-42c9-8326-d8c9e29ddab6 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693a74f430>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:03.108920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a49edadc-c920-42c9-8326-d8c9e29ddab6 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.178160 Jun 15 15:04:03.127413 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 551/1074] 10.222.0.23 () {58 vars in 1166 bytes} [Wed Jun 15 15:04:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:03.129183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dedb9755-2f09-45d7-a420-02265ccd2fe7 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693ac39820>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:03.239834 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dedb9755-2f09-45d7-a420-02265ccd2fe7 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.116281 Jun 15 15:04:03.240407 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 524/1075] 10.222.0.23 () {58 vars in 1169 bytes} [Wed Jun 15 15:04:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:03.256979 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2f415bbe-8b31-4539-9454-c35adf510beb tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693a6fd670>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:03.367469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2f415bbe-8b31-4539-9454-c35adf510beb tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.106220 Jun 15 15:04:03.367469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 552/1076] 10.222.0.23 () {58 vars in 1154 bytes} [Wed Jun 15 15:04:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:03.380523 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6dface1d-1b97-45e7-97eb-9be46daed323 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693abcc4c0>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:03.556906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6dface1d-1b97-45e7-97eb-9be46daed323 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.179527 Jun 15 15:04:03.557855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 525/1077] 10.222.0.23 () {58 vars in 1187 bytes} [Wed Jun 15 15:04:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:03.564936 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9c92c744-f681-4aba-b2fe-95620d020b47 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] Calling method '.version_select at 0x7f693a576670>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:03.665935 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:03.667189 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:03.678763 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:03.679216 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:03.679995 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:03.681139 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:03.724453 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:03.782467 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9c92c744-f681-4aba-b2fe-95620d020b47 tempest-VolumesTestJSON-1280182940 tempest-VolumesTestJSON-1280182940-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.223296 Jun 15 15:04:03.784083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 553/1078] 10.222.0.23 () {58 vars in 1154 bytes} [Wed Jun 15 15:04:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:03.899019 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-597c8624-d753-4aaf-84f5-90289008adef req-779f1249-2be6-4c6a-bba8-feabad01b945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb303ec8-293e-4a9f-be0d-dbb848bdeb22", "tag": "7da5816b-c50f-4fe3-9c64-d6a068219456"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:03.919347 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-597c8624-d753-4aaf-84f5-90289008adef req-779f1249-2be6-4c6a-bba8-feabad01b945 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:03.919820 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-597c8624-d753-4aaf-84f5-90289008adef req-779f1249-2be6-4c6a-bba8-feabad01b945 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:03.963952 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-597c8624-d753-4aaf-84f5-90289008adef req-779f1249-2be6-4c6a-bba8-feabad01b945 service nova] Creating event network-changed:7da5816b-c50f-4fe3-9c64-d6a068219456 for instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 on hv-cinder-84517 Jun 15 15:04:03.967753 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-597c8624-d753-4aaf-84f5-90289008adef req-779f1249-2be6-4c6a-bba8-feabad01b945 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070734 Jun 15 15:04:03.970834 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 554/1079] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:04:04.002441 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:04.004927 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0cba695a-85be-481f-9d56-d37496b5b46c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.342206 Jun 15 15:04:04.006454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 526/1080] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:03 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:05.028225 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:05.028948 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:05.036232 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:05.036698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:05.037491 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:05.037943 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:05.207031 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:05.216931 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e96db843-4cd4-4f25-b018-23d88eac521e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.194044 Jun 15 15:04:05.218637 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 555/1081] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:05 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:06.235650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:06.236346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:06.243769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:06.244943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:06.245786 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:06.246253 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:06.398245 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:06.406626 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-283f7e34-39ec-4569-bdd9-07184ce06b07 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.174927 Jun 15 15:04:06.407949 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 527/1082] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:06 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:06.604998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-6da8c635-2162-4aee-96b5-9493732be4ab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:06.606456 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-6da8c635-2162-4aee-96b5-9493732be4ab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:06.622500 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6da8c635-2162-4aee-96b5-9493732be4ab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:06.623057 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6da8c635-2162-4aee-96b5-9493732be4ab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:06.623988 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6da8c635-2162-4aee-96b5-9493732be4ab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:06.624499 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-6da8c635-2162-4aee-96b5-9493732be4ab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:06.655671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-6da8c635-2162-4aee-96b5-9493732be4ab tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056996 Jun 15 15:04:06.656247 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 556/1083] 10.222.0.23 () {60 vars in 1342 bytes} [Wed Jun 15 15:04:06 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:06.720678 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:06.721159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:06.727109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:06.730419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:06.731043 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:06.731984 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:06.732577 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:06.763596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:04:07.148131 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-44fce2c9-672a-4046-a8d8-170d86cdb2c3 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 204 len: 0 microversion: 2.20 time: 0.431287 Jun 15 15:04:07.148997 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 528/1084] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Jun 15 15:04:06 2022] DELETE /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 15:04:07.158544 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:07.159346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:07.172501 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=6 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:07.177994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:07.178478 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:07.179269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:07.179701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:07.321180 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:07.330414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:07.331870 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:07.333033 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-800f084f-5270-442e-a578-23e5f9f87408 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.178503 Jun 15 15:04:07.333582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 557/1085] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:07 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:07.426268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:07.428127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:07.436829 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:07.438017 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:07.439248 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:07.439693 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:07.626446 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:07.638928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ffc4afd8-6950-420f-8e15-dbc3e3f6b158 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.217034 Jun 15 15:04:07.639602 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 529/1086] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:07 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:08.356331 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:08.357160 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:08.364756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:08.365249 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:08.366058 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:08.366545 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:08.546686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:08.558391 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:08.559887 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:08.561060 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1902f953-5e7d-45b7-8e0f-516c8b673706 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.212121 Jun 15 15:04:08.562227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 558/1087] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:08 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:08.659026 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:08.660500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:08.676967 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:08.677654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:08.679062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:08.679697 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:08.840330 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:08.848593 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5c9f8d35-6e17-436a-b8c0-adb5c4f5eecb tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.194858 Jun 15 15:04:08.849612 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 530/1088] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:08 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:09.581900 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:09.582739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:09.593127 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:09.593584 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:09.594910 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:09.595429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:09.745172 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:09.756316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:09.758324 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:09.760054 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-019f97f7-f93b-4b25-861e-3d9c2cefda28 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.183435 Jun 15 15:04:09.761537 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 559/1089] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:09 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:09.878928 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=10 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:09.887672 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:09.888724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:09.895839 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:09.896637 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:09.898628 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:09.899277 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:10.079935 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:10.092135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-2a91ba20-7cb0-42a9-b1a1-d7d5dccb96cc tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.214886 Jun 15 15:04:10.092756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 531/1090] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:09 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:10.779687 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:10.780499 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:10.788153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:10.788970 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:10.790197 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:10.791363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:10.957539 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:10.965738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:10.967313 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:10.968476 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-ba60c44d-9094-454c-a4f4-ed2ea64f0b03 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.193416 Jun 15 15:04:10.969024 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 560/1091] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:10 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:11.109424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:11.110062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:11.117066 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:11.117428 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:11.118269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:11.118956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:11.256697 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:11.268365 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-23568910-9273-4365-9e89-3c29c026dad8 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.162535 Jun 15 15:04:11.268957 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 532/1092] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:11 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:11.988308 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:11.988928 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:11.996168 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:11.997103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:11.997881 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:11.998363 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:12.135488 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:12.141787 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:12.143371 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:12.144540 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d2b33d89-6c9b-4389-93e4-bf250769e219 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.160352 Jun 15 15:04:12.145100 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 561/1093] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:11 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:12.285972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:12.286551 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:12.295023 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:12.295477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:12.296256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:12.296696 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:12.423977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:12.432080 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6d58ee82-311b-4d35-950c-9b378bfafc78 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.149618 Jun 15 15:04:12.432731 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 533/1094] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:12 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:13.166742 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:13.167669 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:13.179252 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:13.192872 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:13.192872 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:13.192872 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:13.353634 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:13.361624 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:13.363283 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:13.364452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-af526722-b6c1-479d-9a86-1feda80aff6c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.205359 Jun 15 15:04:13.365009 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 562/1095] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:13 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:13.449486 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:13.450107 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:13.456653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:13.457105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:13.457869 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:13.458343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:13.721477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:13.729803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3d9b7733-32f7-4fbb-86e1-d5d0e40e63d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.284827 Jun 15 15:04:13.736115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 534/1096] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:13 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:14.383480 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:14.384825 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:14.391328 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:14.391775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:14.392540 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:14.392975 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:14.670468 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:14.684555 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:14.686065 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:14.687573 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0fdba67a-18c2-4354-a41d-c2d962eab2dd tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1723 microversion: 2.20 time: 0.308196 Jun 15 15:04:14.688830 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 563/1097] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:14 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:14.747375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:14.747993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:14.754498 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:14.754939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:14.755695 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:14.756159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:14.981306 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:14.989144 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d47f3234-154a-432b-b791-6328685fab41 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.246247 Jun 15 15:04:14.989708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 535/1098] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:14 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:15.175660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-3a2b6830-4f47-4c25-abb6-33bc44d31a6a req-f0084cbf-86cb-4c82-80c8-3a7e110e5258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1", "name": "network-vif-deleted", "tag": "3c15b40b-3126-4ab0-8e3c-b2ed2188737c"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:15.184514 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3a2b6830-4f47-4c25-abb6-33bc44d31a6a req-f0084cbf-86cb-4c82-80c8-3a7e110e5258 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:15.185045 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3a2b6830-4f47-4c25-abb6-33bc44d31a6a req-f0084cbf-86cb-4c82-80c8-3a7e110e5258 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:15.196136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-3a2b6830-4f47-4c25-abb6-33bc44d31a6a req-f0084cbf-86cb-4c82-80c8-3a7e110e5258 service nova] Creating event network-vif-deleted:3c15b40b-3126-4ab0-8e3c-b2ed2188737c for instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 on hv-cinder-84517 Jun 15 15:04:15.201226 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-3a2b6830-4f47-4c25-abb6-33bc44d31a6a req-f0084cbf-86cb-4c82-80c8-3a7e110e5258 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029226 Jun 15 15:04:15.201814 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 564/1099] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:15.708051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:15.708818 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:15.716481 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:15.716939 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:15.717724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:15.718183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:15.780627 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:15.788794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:15.790990 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:15.793354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7e8f614d-259a-4f92-aaaa-cecadb030f33 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1655 microversion: 2.20 time: 0.089231 Jun 15 15:04:15.793354 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 536/1100] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:15 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:16.007609 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:16.008307 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:16.016524 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:16.016971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:16.017760 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:16.018216 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:16.182487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:16.199333 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-da4d066f-59da-4fa4-aead-90d649757022 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.191180 Jun 15 15:04:16.200420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 565/1101] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:16 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:16.811978 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:16.812526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:16.819205 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:16.819651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:16.820406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:16.820842 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:16.886324 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:16.894663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:16.896168 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:16.897344 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ffc8cfd3-58e7-4a14-9001-aa25fb0f7791 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1366 microversion: 2.20 time: 0.089496 Jun 15 15:04:16.897907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 537/1102] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:16 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:17.220386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:17.221999 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:17.234258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:17.235078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:17.236927 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:17.237996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:17.386908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:17.395212 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b97c00e2-d536-44b4-b892-b4319439545b tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.181332 Jun 15 15:04:17.395969 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 566/1103] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:17 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:17.915651 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:17.916322 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:17.922879 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:17.923332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:17.924094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:17.924534 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:17.954160 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:17.954639 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:17.955082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lazy-loading 'fault' on Instance uuid 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:04:17.996369 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:18.004226 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:18.005727 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:18.006915 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dbf9aa37-cd94-47cd-ad01-0504eed0b86b tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1371 microversion: 2.20 time: 0.095750 Jun 15 15:04:18.007463 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 538/1104] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:17 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:18.412719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:18.413576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:18.420281 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:18.420774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:18.421556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:18.422003 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:18.552372 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:18.561001 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-23c33e0c-6729-4c12-87c1-8ed7ec502503 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.152055 Jun 15 15:04:18.561578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 567/1105] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:18 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:19.025840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:19.026489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:19.032958 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:19.033405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:19.034164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:19.034620 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:19.069171 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:19.069629 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:19.075043 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lazy-loading 'fault' on Instance uuid 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:04:19.112299 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:19.121613 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:19.123219 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf1b5d8cbfbb450da8878719c4aa6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7ed2c773bd43c7a0845599bfb902ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:19.124367 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ee4712ff-8665-4722-a738-bd6735f856e9 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 200 len: 1371 microversion: 2.20 time: 0.102981 Jun 15 15:04:19.124926 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 539/1106] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:19 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:04:19.577445 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:19.578061 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:19.584576 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:19.585031 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:19.585794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:19.586256 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:19.715581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:19.723246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-51096418-9862-4b9a-ae4c-728089cf2d7c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.149841 Jun 15 15:04:19.723808 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 568/1107] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:19 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:20.142563 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:20.143156 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:20.149665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:20.150353 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:20.151477 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:20.151917 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:20.168656 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] HTTP exception thrown: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Request method failure captured: Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 HTTP/1.1 Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfL1WmLQfeD1ak5dH1auFzRh9miLxkUjG5H_AAIScREgNtusQeaZTJi3cb1qft-ndiYP41okwXnoJtPzhfUiVCFWm0dTGcroJFigBrt4Pmfm4LLgDX5kL8wiC5CnuIomNIPlJfUvLOoyr6OnGvACCAxT4ES8axCgUGewfIb3wk8BIdQ Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:04:20.170454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: bf1b5d8cbfbb450da8878719c4aa6712 Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:20.171977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1'} Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:04:20.173479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:20.174819 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:20.177114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Returning 404 to user: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:04:20.177114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ef232cca-f925-4f1d-94d5-bac9b18a94db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 404 len: 111 microversion: 2.20 time: 0.033186 Jun 15 15:04:20.177114 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 540/1108] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:20 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:04:20.181023 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a7d7bc3c-9efd-48b1-96b5-073ee88b5b79 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '.version_select at 0x7f693a576f70>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:20.256998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a7d7bc3c-9efd-48b1-96b5-073ee88b5b79 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275100580" status: 204 len: 0 microversion: 2.20 time: 0.079813 Jun 15 15:04:20.257567 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 569/1109] 10.222.0.23 () {60 vars in 1261 bytes} [Wed Jun 15 15:04:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275100580 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 15:04:20.740215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:20.741046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:20.748207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:20.748670 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:20.749456 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:20.749899 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:20.754334 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:20.882500 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:20.890355 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-28edef9a-1d29-4dae-8332-578b12925126 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.154273 Jun 15 15:04:20.890914 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 541/1110] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:20 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:21.908619 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:21.909188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:21.918235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:21.918235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:21.918235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:21.918235 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:21.923645 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:22.071549 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:22.079172 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5dbe3ec4-3bea-4de4-9b71-c911da581765 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.175373 Jun 15 15:04:22.079807 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 570/1111] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:21 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:22.416468 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:22.416969 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:22.424663 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:22.425163 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:22.425951 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:22.426426 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:22.440715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] HTTP exception thrown: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Request method failure captured: Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: DELETE /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 HTTP/1.1 Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfL1WmLQfeD1ak5dH1auFzRh9miLxkUjG5H_AAIScREgNtusQeaZTJi3cb1qft-ndiYP41okwXnoJtPzhfUiVCFWm0dTGcroJFigBrt4Pmfm4LLgDX5kL8wiC5CnuIomNIPlJfUvLOoyr6OnGvACCAxT4ES8axCgUGewfIb3wk8BIdQ Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:04:22.442527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: bf1b5d8cbfbb450da8878719c4aa6712 Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.443854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1'} Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:04:22.444608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.445856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.448855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Returning 404 to user: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:04:22.448855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3a6e09ea-8550-46d4-9804-0ae8379b772c tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 404 len: 111 microversion: 2.20 time: 0.032212 Jun 15 15:04:22.448855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 542/1112] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Jun 15 15:04:22 2022] DELETE /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:04:22.455747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:22.456369 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:22.462886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:22.463250 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:22.464033 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:22.465143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:22.479434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] HTTP exception thrown: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Request method failure captured: Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 HTTP/1.1 Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL1WmLQfeD1ak5dH1auFzRh9miLxkUjG5H_AAIScREgNtusQeaZTJi3cb1qft-ndiYP41okwXnoJtPzhfUiVCFWm0dTGcroJFigBrt4Pmfm4LLgDX5kL8wiC5CnuIomNIPlJfUvLOoyr6OnGvACCAxT4ES8axCgUGewfIb3wk8BIdQ Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:04:22.482152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: bf1b5d8cbfbb450da8878719c4aa6712 Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.483929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1'} Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:04:22.484810 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. Jun 15 15:04:22.486358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:22.488323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Returning 404 to user: Instance 4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:04:22.488323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-07b2797e-7be5-4ba1-8ba4-79357bfea4db tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1" status: 404 len: 111 microversion: 2.20 time: 0.032126 Jun 15 15:04:22.488323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 571/1113] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:22 2022] GET /compute/v2.1/servers/4d6fa213-edd9-4c99-8d09-fc73b8a3f8d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:04:22.692741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-b20499cb-4991-4eeb-b217-a49ac16fe33d req-f0466195-6d0d-4f4a-804e-f55c5d03ea8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb303ec8-293e-4a9f-be0d-dbb848bdeb22", "name": "network-vif-plugged", "status": "completed", "tag": "7da5816b-c50f-4fe3-9c64-d6a068219456"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:22.702010 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-b20499cb-4991-4eeb-b217-a49ac16fe33d req-f0466195-6d0d-4f4a-804e-f55c5d03ea8c service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:22.702475 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-b20499cb-4991-4eeb-b217-a49ac16fe33d req-f0466195-6d0d-4f4a-804e-f55c5d03ea8c service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:22.714476 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-b20499cb-4991-4eeb-b217-a49ac16fe33d req-f0466195-6d0d-4f4a-804e-f55c5d03ea8c service nova] Creating event network-vif-plugged:7da5816b-c50f-4fe3-9c64-d6a068219456 for instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 on hv-cinder-84517 Jun 15 15:04:22.721197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-b20499cb-4991-4eeb-b217-a49ac16fe33d req-f0466195-6d0d-4f4a-804e-f55c5d03ea8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032296 Jun 15 15:04:22.721812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 543/1114] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:23.095686 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:23.096310 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:23.103050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:23.103504 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:23.104289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:23.104736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:23.269342 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:23.276879 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-86450a82-8e83-4911-a8bf-e5041fd8ebc0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.185357 Jun 15 15:04:23.277442 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 572/1115] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:23 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:23.881200 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:23.881784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:23.888700 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:23.889146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:23.889908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:23.890384 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:23.903909 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] HTTP exception thrown: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Request method failure captured: Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: DELETE /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 HTTP/1.1 Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfL1WmLQfeD1ak5dH1auFzRh9miLxkUjG5H_AAIScREgNtusQeaZTJi3cb1qft-ndiYP41okwXnoJtPzhfUiVCFWm0dTGcroJFigBrt4Pmfm4LLgDX5kL8wiC5CnuIomNIPlJfUvLOoyr6OnGvACCAxT4ES8axCgUGewfIb3wk8BIdQ Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:04:23.905608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: bf1b5d8cbfbb450da8878719c4aa6712 Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.907261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '77f6014d-9ea6-47c4-af6c-719e09d8d193'} Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:04:23.908120 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.909547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.911068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Returning 404 to user: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:04:23.911068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3ac9c6c5-0cfd-458c-8e39-566f3fc811ba tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "DELETE /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 404 len: 111 microversion: 2.20 time: 0.030321 Jun 15 15:04:23.911068 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 544/1116] 10.222.0.23 () {60 vars in 1279 bytes} [Wed Jun 15 15:04:23 2022] DELETE /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:04:23.915800 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:23.916419 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] [instance: 77f6014d-9ea6-47c4-af6c-719e09d8d193] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:23.923228 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:23.923683 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:23.924452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:23.924893 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:23.939858 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] HTTP exception thrown: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Request method failure captured: Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 HTTP/1.1 Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfL1WmLQfeD1ak5dH1auFzRh9miLxkUjG5H_AAIScREgNtusQeaZTJi3cb1qft-ndiYP41okwXnoJtPzhfUiVCFWm0dTGcroJFigBrt4Pmfm4LLgDX5kL8wiC5CnuIomNIPlJfUvLOoyr6OnGvACCAxT4ES8axCgUGewfIb3wk8BIdQ Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:04:23.941386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5f7ed2c773bd43c7a0845599bfb902ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 5f7ed2c773bd43c7a0845599bfb902ec Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-566597504 Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: bf1b5d8cbfbb450da8878719c4aa6712 Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-AttachVolumeShelveTestJSON-566597504-project Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.943099 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '77f6014d-9ea6-47c4-af6c-719e09d8d193'} Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:04:23.943971 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. Jun 15 15:04:23.945416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:23.946774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] Returning 404 to user: Instance 77f6014d-9ea6-47c4-af6c-719e09d8d193 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:04:23.946774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e319349a-0a64-481f-b9ca-8cea6f797d06 tempest-AttachVolumeShelveTestJSON-566597504 tempest-AttachVolumeShelveTestJSON-566597504-project] 10.222.0.23 "GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193" status: 404 len: 111 microversion: 2.20 time: 0.031087 Jun 15 15:04:23.946774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 573/1117] 10.222.0.23 () {60 vars in 1276 bytes} [Wed Jun 15 15:04:23 2022] GET /compute/v2.1/servers/77f6014d-9ea6-47c4-af6c-719e09d8d193 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:04:24.294811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:24.295539 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:24.301943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:24.302669 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:24.303527 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:24.304160 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:24.471230 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:24.478774 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-30a1ac44-e104-44df-b01c-7a34d38d90d0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1358 microversion: 2.1 time: 0.188731 Jun 15 15:04:24.479331 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 545/1118] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:24 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:25.495723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:25.497046 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:25.509964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:25.509964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:25.509964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:25.509964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:25.731574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:25.747462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-074f855c-ea6d-43ae-9d98-18ebc6ebfd5a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1549 microversion: 2.1 time: 0.255613 Jun 15 15:04:25.749232 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 574/1119] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:25 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1549 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:25.767272 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:25.768692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:25.777702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:25.777702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:25.777702 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:25.778063 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:25.982630 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:25.992427 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b86a8936-5b2a-4b18-8e5d-687f495f1bb6 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1549 microversion: 2.1 time: 0.228906 Jun 15 15:04:25.996146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 546/1120] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:25 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:26.010689 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:26.014334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:26.015115 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Searching by: {'deleted': False, 'project_id': '019a9c2e2943403ab0700a96af732826'} {{(pid=124694) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 15:04:26.022269 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:26.024802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:26.024802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:26.024802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:26.137537 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.multi_cell_list [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124694) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 15:04:26.284660 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7561515d-f0df-43be-ad99-e972ba5e943c tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.277652 Jun 15 15:04:26.285572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 575/1121] 10.222.0.23 () {58 vars in 1124 bytes} [Wed Jun 15 15:04:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:26.297018 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:26.303437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:26.304437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:26.305097 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:26.306508 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:26.307204 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:26.807218 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:26.815186 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-63ff86c6-9e6e-483c-a548-ae6e5038bf4f tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1549 microversion: 2.1 time: 0.523206 Jun 15 15:04:26.815749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 547/1122] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:26 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1549 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:27.070722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:27.071911 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:27.080391 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:27.081074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:27.082403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:27.082870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-ee6a4440-3f7a-4b74-82c9-e9a8b903d884 req-d86a18a7-50a3-4071-81aa-50848504ee99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0407de-1fe3-40c9-92ff-a14f1a81f985", "tag": "e4963401-4f83-4506-b6d9-cef4682f75eb"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:27.083240 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:27.118633 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-ee6a4440-3f7a-4b74-82c9-e9a8b903d884 req-d86a18a7-50a3-4071-81aa-50848504ee99 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:27.122772 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-ee6a4440-3f7a-4b74-82c9-e9a8b903d884 req-d86a18a7-50a3-4071-81aa-50848504ee99 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:27.128303 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:04:27.151729 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-ee6a4440-3f7a-4b74-82c9-e9a8b903d884 req-d86a18a7-50a3-4071-81aa-50848504ee99 service nova] Creating event network-changed:e4963401-4f83-4506-b6d9-cef4682f75eb for instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 on hv-cinder-84517 Jun 15 15:04:27.159985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-ee6a4440-3f7a-4b74-82c9-e9a8b903d884 req-d86a18a7-50a3-4071-81aa-50848504ee99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081176 Jun 15 15:04:27.160691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 548/1123] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:27.715903 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b092f7f2-249d-42cf-af02-68c027040d89 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 204 len: 0 microversion: 2.1 time: 0.649973 Jun 15 15:04:27.717307 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 576/1124] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:04:27 2022] DELETE /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:04:27.726865 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:27.727579 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:27.735421 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:27.741436 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:27.741436 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:27.741436 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:28.083419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:28.097788 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c521ac37-84b2-442d-b83f-e4cacfb1742c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.375494 Jun 15 15:04:28.099396 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 549/1125] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:27 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:29.118770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:29.120315 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:29.125029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:29.131258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:29.131791 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:29.132511 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:29.133581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:29.331089 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:29.339368 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-64439ff9-248b-462f-a86a-8bde29857f91 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1569 microversion: 2.1 time: 0.226016 Jun 15 15:04:29.340191 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 577/1126] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:29 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:30.015142 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ae3b92d0-4112-4511-8c13-1971c1467f97 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ba6e448-ebaf-4be8-b19c-3e4b40cb5357"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:30.016433 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ae3b92d0-4112-4511-8c13-1971c1467f97 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:30.019048 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:30.024288 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae3b92d0-4112-4511-8c13-1971c1467f97 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:30.024738 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae3b92d0-4112-4511-8c13-1971c1467f97 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:30.025524 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae3b92d0-4112-4511-8c13-1971c1467f97 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:30.026000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ae3b92d0-4112-4511-8c13-1971c1467f97 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:30.358211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:30.358877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:30.368652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:30.368652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:30.368652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:30.368652 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:30.482048 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:30.492942 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e14535e0-b5c2-4c30-a699-efcdecd74a6c tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1382 microversion: 2.1 time: 0.139821 Jun 15 15:04:30.494345 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 578/1127] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:30 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1382 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:30.507386 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-dadbb5a9-b929-4cc4-9381-cbcc8fb747b0 req-db9fd8a6-890f-45d0-82de-c61d6fd1694b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0407de-1fe3-40c9-92ff-a14f1a81f985", "name": "network-vif-deleted", "tag": "e4963401-4f83-4506-b6d9-cef4682f75eb"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:30.516494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-dadbb5a9-b929-4cc4-9381-cbcc8fb747b0 req-db9fd8a6-890f-45d0-82de-c61d6fd1694b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:30.517003 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-dadbb5a9-b929-4cc4-9381-cbcc8fb747b0 req-db9fd8a6-890f-45d0-82de-c61d6fd1694b service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:30.530028 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-dadbb5a9-b929-4cc4-9381-cbcc8fb747b0 req-db9fd8a6-890f-45d0-82de-c61d6fd1694b service nova] Creating event network-vif-deleted:e4963401-4f83-4506-b6d9-cef4682f75eb for instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 on hv-cinder-84517 Jun 15 15:04:30.535849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-dadbb5a9-b929-4cc4-9381-cbcc8fb747b0 req-db9fd8a6-890f-45d0-82de-c61d6fd1694b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039890 Jun 15 15:04:30.536888 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 579/1128] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:31.024556 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:31.025254 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:31.032793 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.033313 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.034143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.034675 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.071429 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:04:31.185759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ae3b92d0-4112-4511-8c13-1971c1467f97 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.175858 Jun 15 15:04:31.186633 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 550/1129] 10.222.0.23 () {60 vars in 1322 bytes} [Wed Jun 15 15:04:30 2022] POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments => generated 194 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:31.513115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:31.513933 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:31.519763 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7e8c09e4-22d6-4027-9627-55ccfa09ac59 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 204 len: 0 microversion: 2.1 time: 0.499042 Jun 15 15:04:31.523633 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 580/1130] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:04:31 2022] DELETE /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:04:31.535118 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:31.535843 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:31.544166 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.544622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.545395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.545845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.550911 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.551592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.552356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:31.552789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:31.664043 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:31.677388 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8abc711c-35b1-4844-95db-db3e77032f9e tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1218 microversion: 2.1 time: 0.170372 Jun 15 15:04:31.689971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 551/1131] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:31 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:31.767723 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:31.782579 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2723db31-93ff-4824-877b-2b55afda506b tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1576 microversion: 2.1 time: 0.257528 Jun 15 15:04:31.783500 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 581/1132] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:31 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1576 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:32.696359 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:32.697226 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:32.705405 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:32.705875 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:32.706775 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:32.707223 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:32.741157 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:32.741904 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:32.742160 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lazy-loading 'fault' on Instance uuid ef0407de-1fe3-40c9-92ff-a14f1a81f985 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:04:32.784118 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:32.791641 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-6051a7a3-3d64-43f0-af18-806863ab2fe2 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1223 microversion: 2.1 time: 0.099168 Jun 15 15:04:32.792803 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 552/1133] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:32 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:32.800394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:32.801032 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:32.808623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:32.809073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:32.809835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:32.810305 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:32.968042 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:32.977199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0422a61c-8082-44aa-b8b7-18507d360204 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1576 microversion: 2.1 time: 0.180618 Jun 15 15:04:32.977776 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 582/1134] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:32 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:33.815054 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:33.816303 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:33.824724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:33.824724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:33.825574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:33.826092 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:33.862221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:33.862686 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:33.871363 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lazy-loading 'fault' on Instance uuid ef0407de-1fe3-40c9-92ff-a14f1a81f985 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:04:33.943681 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26608323a21f4cb7832b93bdfd971663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06d1766d477e4d3993d1474d6e1a30e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:33.953591 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-25dcc866-3b9a-496b-b264-ba481525dd99 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 200 len: 1223 microversion: 2.1 time: 0.144340 Jun 15 15:04:33.961656 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 553/1135] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:33 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:33.997165 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:33.999529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:34.007758 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:34.008617 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:34.009440 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:34.009761 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:34.268083 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:34.283915 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-69287cd2-6b16-4cd9-a408-3d634e1eff5e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1576 microversion: 2.1 time: 0.291437 Jun 15 15:04:34.285339 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 583/1136] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:33 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:34.909691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-73a10f49-41e4-4fe1-9066-871ffaeba1df req-bdbe7260-32dd-4834-855a-7e9cbbfbf770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf20221-daaa-4dc2-87d6-a23729ea9a0a", "name": "network-vif-deleted", "tag": "abd09198-523f-4d79-80c7-8726203d3972"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:34.918864 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-73a10f49-41e4-4fe1-9066-871ffaeba1df req-bdbe7260-32dd-4834-855a-7e9cbbfbf770 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:34.919311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-73a10f49-41e4-4fe1-9066-871ffaeba1df req-bdbe7260-32dd-4834-855a-7e9cbbfbf770 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:34.930737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-73a10f49-41e4-4fe1-9066-871ffaeba1df req-bdbe7260-32dd-4834-855a-7e9cbbfbf770 service nova] Creating event network-vif-deleted:abd09198-523f-4d79-80c7-8726203d3972 for instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a on hv-cinder-84517 Jun 15 15:04:34.936508 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-73a10f49-41e4-4fe1-9066-871ffaeba1df req-bdbe7260-32dd-4834-855a-7e9cbbfbf770 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031044 Jun 15 15:04:34.937440 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 554/1137] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:34.971459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:34.972473 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] [instance: ef0407de-1fe3-40c9-92ff-a14f1a81f985] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:34.982560 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:34.987374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:34.987374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:34.987374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:34.999838 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] HTTP exception thrown: Instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 could not be found. Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Request method failure captured: Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 HTTP/1.1 Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfON0xX-B_iwRyTBJ4IQP0LwIRQqepNmFEoqRv4M-pH0NsDht2iOz0-2ywxjee3pFrSVtjgL6OMziCteESPVXYkWnBFJOBqOo3iwaHxqCoYYMS2B7-QoTT-YpY_Xbqhq_Apk6x-SkENxuSSt8xw-p2XPuEvdBqKhgeOiDDs-3TvbFag Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 06d1766d477e4d3993d1474d6e1a30e6 Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-TestShelveInstance-1868423135 Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:04:35.002264 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06d1766d477e4d3993d1474d6e1a30e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/06d1766d477e4d3993d1474d6e1a30e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_06d1766d477e4d3993d1474d6e1a30e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/06d1766d477e4d3993d1474d6e1a30e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-TestShelveInstance-1868423135 Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 06d1766d477e4d3993d1474d6e1a30e6 Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-TestShelveInstance-1868423135 Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-TestShelveInstance-1868423135-project Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 26608323a21f4cb7832b93bdfd971663 Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-TestShelveInstance-1868423135-project Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 could not be found. Jun 15 15:04:35.003756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'ef0407de-1fe3-40c9-92ff-a14f1a81f985'} Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 could not be found. Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:04:35.004569 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 could not be found. Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 could not be found. Jun 15 15:04:35.006230 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:35.008588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Returning 404 to user: Instance ef0407de-1fe3-40c9-92ff-a14f1a81f985 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:04:35.008588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-eae71a4f-f417-4bfd-90ea-03d98d217e41 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985" status: 404 len: 111 microversion: 2.1 time: 0.036777 Jun 15 15:04:35.008588 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 584/1138] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:34 2022] GET /compute/v2.1/servers/ef0407de-1fe3-40c9-92ff-a14f1a81f985 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:04:35.303556 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:35.304625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:35.311739 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:35.312196 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:35.313358 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:35.313804 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:35.358025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e51a2048-4c54-4074-b4f6-1ae8875e0b37 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] Calling method '.version_select at 0x7f69434f5790>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:35.415249 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:35.424852 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-8b5021ed-5026-44f6-bdc1-3144c440c031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1223 microversion: 2.1 time: 0.125569 Jun 15 15:04:35.426457 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 555/1139] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:35 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1223 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:35.576974 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e51a2048-4c54-4074-b4f6-1ae8875e0b37 tempest-TestShelveInstance-1868423135 tempest-TestShelveInstance-1868423135-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-47818703" status: 202 len: 0 microversion: 2.1 time: 0.223820 Jun 15 15:04:35.577558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 585/1140] 10.222.0.23 () {58 vars in 1247 bytes} [Wed Jun 15 15:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-47818703 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:04:36.444089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:36.445363 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:36.454692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:36.455425 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:36.456390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:36.456991 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:36.517495 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:36.518389 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:36.519009 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lazy-loading 'fault' on Instance uuid fbf20221-daaa-4dc2-87d6-a23729ea9a0a {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:04:36.577618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:36.591398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a2b0ea88-ddb6-4d91-bb5f-500d899b6ba6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 200 len: 1228 microversion: 2.1 time: 0.152428 Jun 15 15:04:36.592600 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 556/1141] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:36 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:37.608677 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:37.613390 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:37.614015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:37.622228 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:37.622685 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:37.623817 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:37.624339 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:37.642015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] HTTP exception thrown: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Request method failure captured: Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a HTTP/1.1 Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfQ-HxDYA1tXp141t3UiLVyF8HbI3_GJX5J7OZeyl512g_sqE5tU3Jc7KT12dSFsI5qMgK7BGZvNgGMwOLA8SSJPsmRrFHmE1wj0wd7HLj0LbY090sN4CflS6z3T8Ggt1IxttMeQMEXklS9_PeGg19FHf1X2a_fHi4nxPvJ2C6doL6o Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:04:37.643640 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_547883446fb944e4811768d29eb67583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/547883446fb944e4811768d29eb67583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-TestVolumeBootPattern-395749310 Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 71f3bb1357f14481bd1850c1153bc253 Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:04:37.645367 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'fbf20221-daaa-4dc2-87d6-a23729ea9a0a'} Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:04:37.646370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:04:37.649271 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:04:37.651861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Returning 404 to user: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:04:37.651861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f0237d3a-65ce-4504-bb09-9411401a3c79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 404 len: 111 microversion: 2.1 time: 0.037357 Jun 15 15:04:37.651861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 586/1142] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:37 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:04:37.764609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1774212111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-284020389", "security_groups": [{"name": "tempest-secgroup-smoke-2103269246"}], "block_device_mapping_v2": [{"uuid": "eb44597f-5d06-440d-921e-ad2262941609", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5d513a22-cd88-4063-a54c-439ca917eee0"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:37.994492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] validate_networks() for [('5d513a22-cd88-4063-a54c-439ca917eee0', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:04:38.960343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:04:38.960343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:04:38.960343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:04:38.960343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:04:38.960343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:04:38.972258 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:38.972872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:38.973756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:38.974297 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:39.003410 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for project 547883446fb944e4811768d29eb67583. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:04:39.008722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for user 71f3bb1357f14481bd1850c1153bc253 and project 547883446fb944e4811768d29eb67583. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:04:39.139091 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:04:39.145183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb44597f-5d06-440d-921e-ad2262941609',volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:04:39.899177 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9e40e92e-6168-4d36-877d-404c05987096 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.138464 Jun 15 15:04:39.899840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 557/1143] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:04:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:04:39.915064 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e23a3710-9c62-4459-a2e2-4465dd8119f1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:39.915880 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e23a3710-9c62-4459-a2e2-4465dd8119f1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:39.984209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e23a3710-9c62-4459-a2e2-4465dd8119f1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:39.998241 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e23a3710-9c62-4459-a2e2-4465dd8119f1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1094 microversion: 2.1 time: 0.086744 Jun 15 15:04:39.999561 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 587/1144] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:39 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:40.383513 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:40.384816 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:40.393648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:40.394595 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:40.395592 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:40.396237 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:40.661073 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:40.685091 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f61b46cd-c776-4ffd-8b82-9076c7f26d51 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1595 microversion: 2.1 time: 0.300996 Jun 15 15:04:40.695362 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 558/1145] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:40 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1595 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:41.034074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a43c03f9-37ce-4bef-a6c7-8ec5a03eb05e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:41.034074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a43c03f9-37ce-4bef-a6c7-8ec5a03eb05e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:41.236552 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a43c03f9-37ce-4bef-a6c7-8ec5a03eb05e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:41.271940 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a43c03f9-37ce-4bef-a6c7-8ec5a03eb05e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1094 microversion: 2.1 time: 0.244295 Jun 15 15:04:41.279598 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 588/1146] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:41 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1094 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:42.297000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:42.298445 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:42.305253 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:42.305708 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:42.306686 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:42.308109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:42.325271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:42.429594 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:42.438149 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-025cbd42-6507-4844-a6ec-0776ad5475cf tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1144 microversion: 2.1 time: 0.145865 Jun 15 15:04:42.439692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 559/1147] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:42 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1144 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:43.455509 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:43.456835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:43.467167 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:43.467643 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:43.468451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:43.468900 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:43.500024 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:43.614722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:43.624351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0aff1ed2-4744-48e9-b2be-e6d8517a1cf1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1144 microversion: 2.1 time: 0.172734 Jun 15 15:04:43.632251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 589/1148] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:43 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1144 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:44.672101 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-e843076f-0bf5-4650-b562-6c2c496b790a req-70edcf75-8ef7-4afb-bc91-2439a54aacc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb303ec8-293e-4a9f-be0d-dbb848bdeb22", "tag": "7da5816b-c50f-4fe3-9c64-d6a068219456"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:44.678659 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:44.679400 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:44.704449 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:44.717319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-e843076f-0bf5-4650-b562-6c2c496b790a req-70edcf75-8ef7-4afb-bc91-2439a54aacc6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:44.717770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-e843076f-0bf5-4650-b562-6c2c496b790a req-70edcf75-8ef7-4afb-bc91-2439a54aacc6 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:44.718142 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:44.719363 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:44.719811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:44.780790 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-e843076f-0bf5-4650-b562-6c2c496b790a req-70edcf75-8ef7-4afb-bc91-2439a54aacc6 service nova] Creating event network-changed:7da5816b-c50f-4fe3-9c64-d6a068219456 for instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 on hv-cinder-84517 Jun 15 15:04:44.821258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-e843076f-0bf5-4650-b562-6c2c496b790a req-70edcf75-8ef7-4afb-bc91-2439a54aacc6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153257 Jun 15 15:04:44.825003 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 590/1149] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:04:44.881026 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:44.898749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9eb636f5-0aa1-40b5-bfe5-1aa0f4b43bdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1192 microversion: 2.1 time: 0.251167 Jun 15 15:04:44.898749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 560/1150] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:44 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1192 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:45.927647 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:45.927647 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:45.929922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:45.930636 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:45.932390 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:45.933022 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:46.031956 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:46.045443 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-666fa40c-a8fe-4ced-9b64-6efa265922ca tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1210 microversion: 2.1 time: 0.137264 Jun 15 15:04:46.046248 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 591/1151] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:45 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:47.063351 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:47.064252 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:47.071133 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:47.071584 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:47.072387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:47.072857 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:47.136035 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:47.143521 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1a5874d1-f30c-4a0e-a0fb-5564add48241 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1210 microversion: 2.1 time: 0.084399 Jun 15 15:04:47.144241 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 561/1152] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:47 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:48.160177 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:48.160794 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:48.168643 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:48.169102 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:48.170212 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:48.170662 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:48.303420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:48.311578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-279c2ead-3a2d-431f-a0cf-6fa32c51f304 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1278 microversion: 2.1 time: 0.155474 Jun 15 15:04:48.312169 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 592/1153] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:48 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:48.806975 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-79aac254-d16b-4c32-9705-3179600b2f32 req-bac528c1-e9cc-44e2-b20e-6e05337a5dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c8eb50-430f-4bb0-ac09-d39f5934e4c3", "tag": "e2129264-53e0-42b2-94ef-9136de45ac6b"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:48.819445 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-79aac254-d16b-4c32-9705-3179600b2f32 req-bac528c1-e9cc-44e2-b20e-6e05337a5dec service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:48.819899 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-79aac254-d16b-4c32-9705-3179600b2f32 req-bac528c1-e9cc-44e2-b20e-6e05337a5dec service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:48.833811 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-79aac254-d16b-4c32-9705-3179600b2f32 req-bac528c1-e9cc-44e2-b20e-6e05337a5dec service nova] Creating event network-changed:e2129264-53e0-42b2-94ef-9136de45ac6b for instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 on hv-cinder-84517 Jun 15 15:04:48.841291 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-79aac254-d16b-4c32-9705-3179600b2f32 req-bac528c1-e9cc-44e2-b20e-6e05337a5dec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039865 Jun 15 15:04:48.842105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 562/1154] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:04:49.329393 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:49.330016 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:49.336782 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:49.338077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:49.343317 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:49.343778 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:49.550146 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:49.559251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c181f61d-48ea-4aff-a375-65ca2216f1e2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.233827 Jun 15 15:04:49.560074 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 593/1155] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:49 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:50.302040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-897139658"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:50.302773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:50.305083 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:50.305746 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=6 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:50.311581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:50.312088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:50.313730 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:50.314236 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:50.448713 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.network.security_group_api [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Adding security group 54986467-5a9c-4d24-920f-1a909ced329c to port 7da5816b-c50f-4fe3-9c64-d6a068219456 Jun 15 15:04:50.583270 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:50.584729 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:50.593707 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:50.594846 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:50.595996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:50.596882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:50.825802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:50.833531 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f989284f-9936-442f-8e74-7c99d225922f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.259369 Jun 15 15:04:50.843781 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 594/1156] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:50 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:50.996905 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7a8a8dfd-2b7f-436e-b904-0ba10c9b270e tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/action" status: 202 len: 0 microversion: 2.1 time: 0.697729 Jun 15 15:04:50.996905 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 563/1157] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:04:50 2022] POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:04:51.004490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:51.005107 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:51.012875 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:51.013328 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:51.014650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:51.014650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:51.135494 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-75aed8a1-dc28-4a33-8e92-3ec75809bc5a req-c1ea9928-0b0a-4c40-885d-64f62380de4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb303ec8-293e-4a9f-be0d-dbb848bdeb22", "tag": "7da5816b-c50f-4fe3-9c64-d6a068219456"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:04:51.143783 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-75aed8a1-dc28-4a33-8e92-3ec75809bc5a req-c1ea9928-0b0a-4c40-885d-64f62380de4a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:51.144226 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-75aed8a1-dc28-4a33-8e92-3ec75809bc5a req-c1ea9928-0b0a-4c40-885d-64f62380de4a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:51.156502 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-75aed8a1-dc28-4a33-8e92-3ec75809bc5a req-c1ea9928-0b0a-4c40-885d-64f62380de4a service nova] Creating event network-changed:7da5816b-c50f-4fe3-9c64-d6a068219456 for instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 on hv-cinder-84517 Jun 15 15:04:51.161977 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-75aed8a1-dc28-4a33-8e92-3ec75809bc5a req-c1ea9928-0b0a-4c40-885d-64f62380de4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030160 Jun 15 15:04:51.163272 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 564/1158] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:04:51.271507 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=4 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:04:51.416789 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:51.426866 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8b3d7710-729e-4405-b2f6-a6f3ffe62cb4 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1760 microversion: 2.1 time: 0.426189 Jun 15 15:04:51.427722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 595/1159] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:50 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1760 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:51.852145 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:51.852870 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:51.868344 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:51.869685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:51.871930 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:51.873258 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:52.087060 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:52.094365 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e2a77e36-d539-4da8-b703-46b9941db071 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.246625 Jun 15 15:04:52.094929 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 565/1160] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:51 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:53.111653 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:53.115830 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:53.119966 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:53.120506 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:53.121296 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:53.121739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:53.264654 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:53.272148 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-28f3d506-d007-45e1-b841-a69ce5c88111 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.164343 Jun 15 15:04:53.272919 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 596/1161] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:53 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:54.289091 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:54.289794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:54.304198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:54.304654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:54.305434 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:54.305872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:54.479360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:54.492360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-61487180-8763-4b62-b15f-3f66d428bbdb tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.207174 Jun 15 15:04:54.495691 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 566/1162] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:54 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:55.511355 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:55.511965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:55.518754 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:55.519206 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:55.519967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:55.520406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:55.651385 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:55.658972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-eb7e5a98-b052-47cf-9240-3b31d65fd5de tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.152121 Jun 15 15:04:55.659563 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 597/1163] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:55 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:56.676356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:56.676960 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:56.688058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:56.688494 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:56.689271 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:56.689706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:56.821173 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:56.830652 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-78cd8fda-8a97-4647-8563-94ecf9c01d80 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.158102 Jun 15 15:04:56.831284 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 567/1164] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:56 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:04:57.848352 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:57.849016 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:57.856702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:57.857153 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:57.857948 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:57.858384 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:57.996162 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:58.003653 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-f6ca461d-bdde-4500-8a89-f6a0da4326fc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.159347 Jun 15 15:04:58.004209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 598/1165] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:57 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:04:59.021668 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:04:59.022412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:04:59.029489 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:59.029993 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:59.030779 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:04:59.031221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:04:59.188128 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:04:59.198021 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c2440310-aa37-4173-932e-9527a330de16 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.179499 Jun 15 15:04:59.198733 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 568/1166] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:04:59 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:00.215384 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:00.216597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:00.223311 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:00.223762 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:00.224840 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:00.225325 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:00.374699 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:00.382420 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c7001ed5-8ce5-432a-801c-ed78af92e5cd tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.171295 Jun 15 15:05:00.383004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 599/1167] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:00 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:01.399954 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:01.401231 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:01.408645 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:01.409336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:01.410465 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:01.410916 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:01.559365 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:01.567335 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-e6fe7b62-8b19-474e-b838-f222e8849a79 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.171258 Jun 15 15:05:01.567985 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 569/1168] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:01 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:01.778751 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-3b237e4f-d035-482c-be25-f6baafcd63c9 req-df77a2a9-23f1-4c62-b768-10ed544a7143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c8eb50-430f-4bb0-ac09-d39f5934e4c3", "name": "network-vif-plugged", "status": "completed", "tag": "e2129264-53e0-42b2-94ef-9136de45ac6b"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:01.787490 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3b237e4f-d035-482c-be25-f6baafcd63c9 req-df77a2a9-23f1-4c62-b768-10ed544a7143 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:01.787931 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3b237e4f-d035-482c-be25-f6baafcd63c9 req-df77a2a9-23f1-4c62-b768-10ed544a7143 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:01.800108 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-3b237e4f-d035-482c-be25-f6baafcd63c9 req-df77a2a9-23f1-4c62-b768-10ed544a7143 service nova] Creating event network-vif-plugged:e2129264-53e0-42b2-94ef-9136de45ac6b for instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 on hv-cinder-84517 Jun 15 15:05:01.805129 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-3b237e4f-d035-482c-be25-f6baafcd63c9 req-df77a2a9-23f1-4c62-b768-10ed544a7143 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030224 Jun 15 15:05:01.805973 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 600/1169] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:02.586752 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:02.587399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:02.598854 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:02.599596 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:02.600889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:02.603091 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:02.758814 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:02.769947 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c5ab82bb-ce00-4b7d-bbaa-bb16cd059fa2 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.187839 Jun 15 15:05:02.770558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 570/1170] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:02 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:03.787488 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:03.788184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:03.800152 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:03.800617 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:03.801392 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:03.801828 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:03.944096 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:03.954005 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-76338c97-2db7-48b1-82d5-0249cd414939 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.168926 Jun 15 15:05:03.954641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 601/1171] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:03 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:04.971082 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:04.971706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:04.975357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:04.979056 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:04.979538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:04.980314 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:04.980755 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:05.117583 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:05.126522 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-73966e2f-440c-4ec0-921d-d50eef1867b6 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.159535 Jun 15 15:05:05.127102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 571/1172] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:04 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:05.581245 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1252923575", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "networks": [{"uuid": "6dd9afc3-97fa-4710-a10c-6b66590125ca"}]}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:05.590483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:05.644680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.network.neutron [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] validate_networks() for [('6dd9afc3-97fa-4710-a10c-6b66590125ca', None, None, None, None, None)] {{(pid=124694) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:05:06.123266 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Flavor limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:05:06.123702 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Image limits 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:05:06.124359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Flavor pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:05:06.124957 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Image pref 0:0:0 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:05:06.126081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.virt.hardware [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124694) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:05:06.140410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:06.141267 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:06.146582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:06.146582 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:06.146919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:06.146919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:06.160563 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:06.160563 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:06.161865 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:06.162385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:06.178436 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Getting quotas for project a5c6a78958cb4d34862e51557f13d0b1. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:05:06.192212 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.quota [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Getting quotas for user f1314d2b3b8145bbb13aea98702d9b43 and project a5c6a78958cb4d34862e51557f13d0b1. Resources: {'ram', 'instances', 'cores'} {{(pid=124694) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:05:06.206077 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Going to run 1 instances... {{(pid=124694) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:05:06.208439 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124694) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:05:06.314199 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:06.324633 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f7daebba-2f72-4684-a800-e45113a2a48c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1266 microversion: 2.1 time: 0.184110 Jun 15 15:05:06.331156 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 572/1173] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:06 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:06.365837 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR oslo.messaging._drivers.impl_rabbit [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [7112f578-756f-4f58-bbc5-1f4a621c4bc3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 15:05:07.343332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:07.343999 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:07.350199 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:07.350665 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:07.351430 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:07.351878 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:07.373898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO oslo.messaging._drivers.impl_rabbit [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [7112f578-756f-4f58-bbc5-1f4a621c4bc3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 34136. Jun 15 15:05:07.379215 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-99be4094-6cf3-4188-9891-33a008921106 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800710 Jun 15 15:05:07.383687 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 602/1174] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:05:07.388801 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-dce08289-09cf-4208-84cd-054d6eebc9c4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:07.389791 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-dce08289-09cf-4208-84cd-054d6eebc9c4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:07.466594 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-dce08289-09cf-4208-84cd-054d6eebc9c4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:07.481361 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-dce08289-09cf-4208-84cd-054d6eebc9c4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1214 microversion: 2.1 time: 0.090701 Jun 15 15:05:07.489462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 603/1175] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:07 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:07.545765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:07.559420 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4b32e087-9913-4eb3-bd36-f83f23d6edc0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1453 microversion: 2.1 time: 0.221155 Jun 15 15:05:07.560454 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 573/1176] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:07 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:07.583597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:07.584175 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:07.591590 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:07.592263 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:07.593052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:07.593495 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:07.726552 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:07.734922 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1f2183f5-690a-4cbd-b798-b503622dfcdc tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1453 microversion: 2.1 time: 0.157073 Jun 15 15:05:07.735487 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 604/1177] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:07 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:08.495768 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-166fd491-fc36-4b90-9067-d5f93ab00f11 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:08.498066 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-166fd491-fc36-4b90-9067-d5f93ab00f11 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:08.567224 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-166fd491-fc36-4b90-9067-d5f93ab00f11 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:08.568882 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-166fd491-fc36-4b90-9067-d5f93ab00f11 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1214 microversion: 2.1 time: 0.079835 Jun 15 15:05:08.569864 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 574/1178] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:08 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:09.587334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:09.589123 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:09.596862 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:09.597581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:09.598581 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:09.598908 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:09.684378 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:09.692720 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3bd0bfab-c682-4ab2-a80c-ce149c4a389a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1266 microversion: 2.1 time: 0.109616 Jun 15 15:05:09.694215 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 605/1179] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:09 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:10.024679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-9f9acbcb-7c8c-4b1b-893b-2b84b90a93e1 req-81289dd4-74ff-4ca7-8162-8ef1322dc90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c8eb50-430f-4bb0-ac09-d39f5934e4c3", "tag": "e2129264-53e0-42b2-94ef-9136de45ac6b"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:10.034411 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-9f9acbcb-7c8c-4b1b-893b-2b84b90a93e1 req-81289dd4-74ff-4ca7-8162-8ef1322dc90c service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:10.034855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-9f9acbcb-7c8c-4b1b-893b-2b84b90a93e1 req-81289dd4-74ff-4ca7-8162-8ef1322dc90c service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:10.046719 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-9f9acbcb-7c8c-4b1b-893b-2b84b90a93e1 req-81289dd4-74ff-4ca7-8162-8ef1322dc90c service nova] Creating event network-changed:e2129264-53e0-42b2-94ef-9136de45ac6b for instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 on hv-cinder-84517 Jun 15 15:05:10.051855 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-9f9acbcb-7c8c-4b1b-893b-2b84b90a93e1 req-81289dd4-74ff-4ca7-8162-8ef1322dc90c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030930 Jun 15 15:05:10.052441 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 575/1180] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:10.711067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:10.712405 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:10.721079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:10.721798 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:10.722756 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:10.723394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:10.837522 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:10.852710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0bf01fb2-8fce-4cb1-99ea-ed04d0f6b92b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1274 microversion: 2.1 time: 0.145493 Jun 15 15:05:10.855242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 606/1181] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:10 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:11.069299 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-71511e75-79d4-4044-b2ae-ec961d2a5238 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:11.070572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-71511e75-79d4-4044-b2ae-ec961d2a5238 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:11.095387 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71511e75-79d4-4044-b2ae-ec961d2a5238 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.095845 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71511e75-79d4-4044-b2ae-ec961d2a5238 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:11.096635 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71511e75-79d4-4044-b2ae-ec961d2a5238 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.097069 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-71511e75-79d4-4044-b2ae-ec961d2a5238 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:11.356554 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-71511e75-79d4-4044-b2ae-ec961d2a5238 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/action" status: 202 len: 0 microversion: 2.1 time: 0.292132 Jun 15 15:05:11.357263 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 576/1182] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:05:11 2022] POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:05:11.367282 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:11.368704 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:11.377499 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.377960 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:11.378898 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.379572 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:11.618394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:11.630645 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0f374754-5a72-4abe-ba0b-f86445a69f34 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1752 microversion: 2.1 time: 0.268578 Jun 15 15:05:11.631280 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 607/1183] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:11 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1752 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:11.872308 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:11.873013 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:11.879610 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.880058 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:11.881011 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:11.881449 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:12.562088 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:12.579075 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-cbabda8a-0935-429d-a40b-8843d526d9aa tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.711235 Jun 15 15:05:12.582805 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 577/1184] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:11 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:12.651968 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:12.675134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:12.675134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:12.675134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:12.675134 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:12.675659 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:12.948578 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:12.957050 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9b4bb69e-7599-4676-adc7-6d16835afe27 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1752 microversion: 2.1 time: 0.311242 Jun 15 15:05:12.957831 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 608/1185] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:12 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1752 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:13.468070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-d64cb50a-2d5e-4b04-8acc-33bc575dd045 req-6eb9e6ad-45b9-4dc6-aea0-32f8a7dc1553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b1bc9d-83e9-43ca-993c-96c1b88587b0", "tag": "8ac787e3-96ee-445d-af06-73997fcf97ec"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:13.477262 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-d64cb50a-2d5e-4b04-8acc-33bc575dd045 req-6eb9e6ad-45b9-4dc6-aea0-32f8a7dc1553 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:13.477720 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-d64cb50a-2d5e-4b04-8acc-33bc575dd045 req-6eb9e6ad-45b9-4dc6-aea0-32f8a7dc1553 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:13.488550 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-d64cb50a-2d5e-4b04-8acc-33bc575dd045 req-6eb9e6ad-45b9-4dc6-aea0-32f8a7dc1553 service nova] Creating event network-changed:8ac787e3-96ee-445d-af06-73997fcf97ec for instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 on hv-cinder-84517 Jun 15 15:05:13.494209 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-d64cb50a-2d5e-4b04-8acc-33bc575dd045 req-6eb9e6ad-45b9-4dc6-aea0-32f8a7dc1553 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029212 Jun 15 15:05:13.494812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 578/1186] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:13.601039 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:13.602743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:13.611374 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:13.612213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:13.613227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:13.613836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:13.618551 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:13.823731 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:13.851087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0a8a531c-9fda-47a6-849b-3db8964f0f1a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.238919 Jun 15 15:05:13.851087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 609/1187] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:13 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:13.975922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:13.976632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:13.983679 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:13.984412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:13.985197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:13.985621 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:13.990101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:14.306392 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:14.315886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dc37347b-8d96-4f4e-a165-7bd3a3e3e233 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.344424 Jun 15 15:05:14.322682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 579/1188] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:13 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:14.858859 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:14.859570 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:14.866403 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:14.867140 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:14.867981 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:14.868486 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:15.039081 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:15.046950 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3033a608-ba2a-43a1-b75a-8f22e248ff7e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.193881 Jun 15 15:05:15.047620 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 610/1189] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:14 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:15.337269 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:15.337884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:15.345890 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:15.346443 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:15.347299 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:15.347837 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:15.499530 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:15.520936 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-fdd46b38-98d0-411a-a486-8a3d6cd93786 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.187344 Jun 15 15:05:15.522053 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 580/1190] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:15 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:16.064233 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:16.064824 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:16.071406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:16.071855 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:16.072753 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:16.073255 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:16.156408 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:16.210634 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:16.218844 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-226de6dd-faf3-4fe2-9bc6-a0d28649c819 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.158363 Jun 15 15:05:16.219681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 611/1191] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:16 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:16.540094 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:16.541117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:16.550293 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:16.551008 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:16.551924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:16.552479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:16.708949 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:16.723632 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-110a2bf2-699f-4c57-a9bb-dfb6fdfccdea tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.188069 Jun 15 15:05:16.724464 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 581/1192] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:16 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:17.236736 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:17.237347 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:17.243985 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:17.244439 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:17.245203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:17.245641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:17.382434 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:17.390954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7cb2d502-02bb-4d58-9bd3-d72895aeb386 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.158225 Jun 15 15:05:17.391346 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 612/1193] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:17 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:17.744923 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:17.746121 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:17.761830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:17.762334 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:17.766545 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:17.766545 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:17.930972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:17.940794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ecfb0ddb-73f9-4431-8053-53ed6cebd300 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.200330 Jun 15 15:05:17.941725 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 582/1194] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:17 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:18.407836 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:18.408451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:18.411378 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=8 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:18.415452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:18.415905 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:18.417471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:18.417719 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:18.559522 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:18.567178 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7ad47180-6525-4140-93c6-a5de90010e93 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.163399 Jun 15 15:05:18.567740 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 613/1195] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:18 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:18.960472 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:18.961091 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:18.963059 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:18.969496 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:18.969956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:18.970751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:18.971192 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:19.125336 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:19.136420 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-adf12701-f53c-4518-a1bb-6b217a8c6e89 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.179336 Jun 15 15:05:19.138227 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 583/1196] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:18 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:19.586201 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:19.586666 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:19.595248 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:19.595802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:19.596529 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:19.596967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:19.736779 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:19.745821 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-af5d2045-6ac5-46e9-86cd-87be8418580a tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.164801 Jun 15 15:05:19.756799 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 614/1197] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:19 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:19.862608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-f21d7d73-686d-4296-85da-92a8364e9b4d req-6e8d2cf8-f966-4ed6-bc79-164c12cbe451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b1bc9d-83e9-43ca-993c-96c1b88587b0", "name": "network-vif-plugged", "status": "completed", "tag": "8ac787e3-96ee-445d-af06-73997fcf97ec"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:19.871129 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f21d7d73-686d-4296-85da-92a8364e9b4d req-6e8d2cf8-f966-4ed6-bc79-164c12cbe451 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:19.876191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-f21d7d73-686d-4296-85da-92a8364e9b4d req-6e8d2cf8-f966-4ed6-bc79-164c12cbe451 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:19.882538 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-f21d7d73-686d-4296-85da-92a8364e9b4d req-6e8d2cf8-f966-4ed6-bc79-164c12cbe451 service nova] Creating event network-vif-plugged:8ac787e3-96ee-445d-af06-73997fcf97ec for instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 on hv-cinder-84517 Jun 15 15:05:19.888558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-f21d7d73-686d-4296-85da-92a8364e9b4d req-6e8d2cf8-f966-4ed6-bc79-164c12cbe451 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 Jun 15 15:05:19.889154 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 584/1198] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:20.154708 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:20.155387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:20.161332 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:20.161968 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:20.162775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:20.163213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:20.390803 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:20.398937 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a84866e9-867a-48e8-b742-8637a0d69ba2 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.248163 Jun 15 15:05:20.399500 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 615/1199] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:20 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:20.764812 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:20.765424 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:20.771770 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:20.783451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:20.783451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:20.783451 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:20.909031 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:20.917582 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-0140d48d-5b42-442d-ac14-7d1e34a47a2b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1314 microversion: 2.1 time: 0.156931 Jun 15 15:05:20.918139 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 585/1200] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:20 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:21.416586 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:21.418967 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:21.423731 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:21.424183 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:21.424949 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:21.425385 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:21.575925 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:21.585273 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-98c259f0-1229-4700-ad9f-22d9528f73b0 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.172555 Jun 15 15:05:21.586285 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 616/1201] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:21 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:21.935030 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:21.938759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:21.942429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:21.942882 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:21.943659 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:21.944099 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:22.117794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:22.126092 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-9f85b01a-53a8-439d-b6a0-e8836d069d5e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1499 microversion: 2.1 time: 0.195682 Jun 15 15:05:22.126935 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 586/1202] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:21 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1499 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:22.603323 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:22.604334 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:22.611341 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:22.611739 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:22.612510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:22.612964 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:22.759142 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:22.767838 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-0d13af01-27c4-4e6e-a059-b7ef81ac3570 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.168568 Jun 15 15:05:22.768407 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 617/1203] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:22 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:23.302259 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:23.302765 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:23.309998 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.310475 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:23.311240 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.311676 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:23.337674 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:05:23.786025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:23.786609 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:23.793889 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.794379 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:23.795155 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.795598 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:23.947689 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-ea068546-67ee-4915-8c58-2d5376d4279e tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 204 len: 0 microversion: 2.1 time: 0.648644 Jun 15 15:05:23.947996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:23.948232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 587/1204] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:05:23 2022] DELETE /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:05:23.956378 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2db9bf1b-8144-413e-a5eb-33ea6b625cfd tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.174201 Jun 15 15:05:23.958360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:23.958485 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 618/1205] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:23 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:23.958604 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:23.964468 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.964851 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:23.965617 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:23.966050 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:24.100899 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:24.108873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-74ced5ee-abad-4d98-a0d8-280f9793ab8c tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1505 microversion: 2.1 time: 0.156243 Jun 15 15:05:24.109479 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 588/1206] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:23 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:24.974418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:24.974986 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:24.987067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:24.987067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:24.987067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:24.987067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:25.125972 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:25.126625 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:25.133581 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:25.133947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:25.140583 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:25.141403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:25.142040 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:25.142864 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-718b566d-7eb7-4cf2-8d6c-f772c9676bc5 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.172374 Jun 15 15:05:25.143558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 619/1207] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:24 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:25.270896 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:25.279143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-07441bcb-c24e-442b-ac9e-2a4cc45c66ac tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1505 microversion: 2.1 time: 0.156976 Jun 15 15:05:25.279706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 589/1208] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:25 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:26.160414 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:26.161063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:26.167852 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.168299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.169071 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.169515 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.296908 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:26.297533 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:26.304257 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.313566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.313566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.313566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.380717 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:26.388563 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-3a3901fa-4d0e-4372-bd5a-b3278b36a9f4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1463 microversion: 2.1 time: 0.095520 Jun 15 15:05:26.389179 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 590/1209] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:26 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1463 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:26.394372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-2382345e-67be-443c-8794-3f698fdea316 req-15e85651-7586-444d-8b60-51f60177e66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b1bc9d-83e9-43ca-993c-96c1b88587b0", "name": "network-vif-deleted", "tag": "8ac787e3-96ee-445d-af06-73997fcf97ec"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:26.402221 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-2382345e-67be-443c-8794-3f698fdea316 req-15e85651-7586-444d-8b60-51f60177e66f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:26.402941 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-2382345e-67be-443c-8794-3f698fdea316 req-15e85651-7586-444d-8b60-51f60177e66f service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:26.412605 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:26.414318 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-2382345e-67be-443c-8794-3f698fdea316 req-15e85651-7586-444d-8b60-51f60177e66f service nova] Creating event network-vif-deleted:8ac787e3-96ee-445d-af06-73997fcf97ec for instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 on hv-cinder-84517 Jun 15 15:05:26.420105 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-2382345e-67be-443c-8794-3f698fdea316 req-15e85651-7586-444d-8b60-51f60177e66f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029772 Jun 15 15:05:26.420699 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 591/1210] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:26.422470 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-1eb53b71-a622-4039-9a86-14d9fa1faa72 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.265909 Jun 15 15:05:26.424326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 620/1211] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:26 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:27.406924 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:27.407797 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:27.414117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:27.414756 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.418193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:27.418193 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.440923 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:27.442223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:27.448745 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:27.449280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.449794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lazy-loading 'fault' on Instance uuid b6b1bc9d-83e9-43ca-993c-96c1b88587b0 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:05:27.452641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:27.452641 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.453164 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:27.453613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:27.506117 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:27.515425 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7ee9ab54-9268-4cce-bb7d-6c71acd7de3b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 200 len: 1304 microversion: 2.1 time: 0.113363 Jun 15 15:05:27.516261 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 592/1212] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:27 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:27.625680 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:27.633710 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2c95dc96-5bf6-4be5-8158-0d9e619d8d80 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.196750 Jun 15 15:05:27.634304 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 621/1213] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:27 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:28.532512 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:28.533356 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: b6b1bc9d-83e9-43ca-993c-96c1b88587b0] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:28.539604 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.540057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.540826 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.541294 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.555404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] HTTP exception thrown: Instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 could not be found. Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Request method failure captured: Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 HTTP/1.1 Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfUcWFzrIBTiUDU-cGsLxpmFYZDVCtJNu84mFqss9rDgA2wNX6Q09eemClCfo9TlCjTv-57PVTm-2OPoMN9xG71vJaH_qo_ZlvWlK_UkUQw1l_mFcKvBT98WCDtiVR2WePRAAFk8yrcZ6dIy5-s97Pf5zNqcyvSBzpb4seiogM3yfBA Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: a5c6a78958cb4d34862e51557f13d0b1 Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesActionsTest-1402300971 Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:05:28.558357 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesActionsTest-1402300971 Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: a5c6a78958cb4d34862e51557f13d0b1 Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesActionsTest-1402300971 Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesActionsTest-1402300971-project Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: f1314d2b3b8145bbb13aea98702d9b43 Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesActionsTest-1402300971-project Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 could not be found. Jun 15 15:05:28.560112 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'b6b1bc9d-83e9-43ca-993c-96c1b88587b0'} Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 could not be found. Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:05:28.561019 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 could not be found. Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 could not be found. Jun 15 15:05:28.562887 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:28.564062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Returning 404 to user: Instance b6b1bc9d-83e9-43ca-993c-96c1b88587b0 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:05:28.564062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-b60e1730-8967-40ca-b176-91f6f8d4c8b7 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0" status: 404 len: 111 microversion: 2.1 time: 0.031075 Jun 15 15:05:28.564062 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 593/1214] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:28 2022] GET /compute/v2.1/servers/b6b1bc9d-83e9-43ca-993c-96c1b88587b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:05:28.652161 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:28.652876 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:28.658998 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.659494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.660274 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:28.660718 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:28.776311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-328146254", "imageRef": "d1bbeb2c-bb76-486e-aa01-4444b6cd7df3", "flavorRef": "452", "networks": [{"uuid": "6dd9afc3-97fa-4710-a10c-6b66590125ca"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:28.808709 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:28.818877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b02de903-76ad-4b3c-93ce-864254bdaf90 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1757 microversion: 2.1 time: 0.169302 Jun 15 15:05:28.818877 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 622/1215] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:28 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:28.834840 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] validate_networks() for [('6dd9afc3-97fa-4710-a10c-6b66590125ca', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:05:29.181455 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:05:29.181926 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:05:29.182554 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:05:29.182973 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:05:29.183393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:05:29.192922 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.193375 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.194208 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.194647 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.212079 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Getting quotas for project a5c6a78958cb4d34862e51557f13d0b1. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:05:29.217275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Getting quotas for user f1314d2b3b8145bbb13aea98702d9b43 and project a5c6a78958cb4d34862e51557f13d0b1. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:05:29.229784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:05:29.232103 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1bbeb2c-bb76-486e-aa01-4444b6cd7df3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:05:29.394575 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-18592568-be0c-4ede-bca5-fa090efeb146 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622222 Jun 15 15:05:29.401622 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 594/1216] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:05:29.405989 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-3b6e70af-6a19-450c-8ed0-e46f26a278ae tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:29.409722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-3b6e70af-6a19-450c-8ed0-e46f26a278ae tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:29.464452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-3b6e70af-6a19-450c-8ed0-e46f26a278ae tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:29.471498 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-3b6e70af-6a19-450c-8ed0-e46f26a278ae tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1213 microversion: 2.1 time: 0.069418 Jun 15 15:05:29.472060 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 623/1217] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:29 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:29.833762 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:29.834419 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:29.842460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.843158 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.843943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:29.844654 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:29.995385 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:30.003574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d9c73c7d-0e99-46e1-a545-4c82d661a688 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1760 microversion: 2.1 time: 0.173766 Jun 15 15:05:30.004135 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 595/1218] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:29 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:30.488879 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e6c8f6a7-0621-4aa8-bfd0-94b3ac39f0f8 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:30.489476 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e6c8f6a7-0621-4aa8-bfd0-94b3ac39f0f8 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:30.543359 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e6c8f6a7-0621-4aa8-bfd0-94b3ac39f0f8 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:30.551954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e6c8f6a7-0621-4aa8-bfd0-94b3ac39f0f8 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1213 microversion: 2.1 time: 0.066798 Jun 15 15:05:30.552770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 624/1219] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:30 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:31.568856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:31.569471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:31.576445 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:31.581469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:31.581469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:31.581469 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:31.594085 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:31.646828 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:31.659397 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1d7ced25-4d24-45a9-b0db-bad4a031c338 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1265 microversion: 2.1 time: 0.094037 Jun 15 15:05:31.660388 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 596/1220] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:31 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:32.679525 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:32.680733 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:32.687811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:32.688289 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:32.689097 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:32.689547 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:32.789783 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:32.798320 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-509c150b-686c-45c4-8995-a14631fcea6b tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1271 microversion: 2.1 time: 0.122617 Jun 15 15:05:32.798853 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 625/1221] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:32 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:33.816138 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:33.816913 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:33.823793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:33.824243 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:33.825015 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:33.825456 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:34.029306 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:34.036650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-056e8ccf-c1ab-4d24-87b5-3f52078faa99 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.224819 Jun 15 15:05:34.046455 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 597/1222] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:33 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:34.173331 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-f473b67d-d116-419b-b7b1-4f60fbaf3ab9 req-083e469d-ebee-48e0-a93a-a99bc8f3775d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b387d3-28b3-4a8e-879b-2cafa7ef59d7", "tag": "62c91794-515f-4658-9e18-73496cbc6fce"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:34.182062 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f473b67d-d116-419b-b7b1-4f60fbaf3ab9 req-083e469d-ebee-48e0-a93a-a99bc8f3775d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:34.182628 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-f473b67d-d116-419b-b7b1-4f60fbaf3ab9 req-083e469d-ebee-48e0-a93a-a99bc8f3775d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:34.195527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-f473b67d-d116-419b-b7b1-4f60fbaf3ab9 req-083e469d-ebee-48e0-a93a-a99bc8f3775d service nova] Creating event network-changed:62c91794-515f-4658-9e18-73496cbc6fce for instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 on hv-cinder-84517 Jun 15 15:05:34.200503 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-f473b67d-d116-419b-b7b1-4f60fbaf3ab9 req-083e469d-ebee-48e0-a93a-a99bc8f3775d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Jun 15 15:05:34.201122 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 626/1223] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:35.054813 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:35.055429 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:35.063290 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:35.063751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:35.064534 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:35.064974 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:35.274858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:35.283343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-26d93769-4f11-479e-b432-1c3c50e534d5 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.232889 Jun 15 15:05:35.283915 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 598/1224] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:35 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:36.301263 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:36.301944 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:36.309513 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:36.309956 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:36.310738 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:36.311167 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:36.440695 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:36.448510 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7f56fa01-6787-4e4f-b811-4e5c1f9a209f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.151377 Jun 15 15:05:36.449087 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 627/1225] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:36 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:37.466459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:37.467098 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:37.469668 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:37.474710 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:37.475164 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:37.475938 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:37.476378 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:37.621793 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:37.629609 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d5c66392-3914-4305-99ca-de8d0ab26579 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.168003 Jun 15 15:05:37.630407 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 599/1226] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:37 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:38.651044 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:38.651688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:38.658489 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:38.658938 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:38.659698 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:38.660136 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:38.682933 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=100 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:38.799627 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:38.807075 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-43f11289-8904-4df7-afca-3aac99a8dd16 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.159914 Jun 15 15:05:38.807639 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 628/1227] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:38 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:39.824278 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:39.825683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:39.828394 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:39.829057 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=6 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:39.834230 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:39.834740 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:39.835514 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:39.835952 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:40.129194 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:40.136682 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-69181b31-f496-49b3-84c6-f93c0a63fb47 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.316370 Jun 15 15:05:40.137976 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 600/1228] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:39 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:41.153945 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:41.154716 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:41.157059 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=4 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:41.157725 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:05:41.162573 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:41.163029 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:41.163801 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:41.164242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:41.299254 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:41.307980 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-668686a2-5d4a-4d70-bba3-dbaa4851ba8f tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.158120 Jun 15 15:05:41.308553 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 629/1229] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:41 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:42.053926 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-1e78f405-d746-43cb-b7b1-1c58fc76a67c req-4d63a4f0-be56-44a1-9e6d-643c9b067c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b387d3-28b3-4a8e-879b-2cafa7ef59d7", "name": "network-vif-plugged", "status": "completed", "tag": "62c91794-515f-4658-9e18-73496cbc6fce"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:42.063332 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-1e78f405-d746-43cb-b7b1-1c58fc76a67c req-4d63a4f0-be56-44a1-9e6d-643c9b067c92 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:42.063778 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-1e78f405-d746-43cb-b7b1-1c58fc76a67c req-4d63a4f0-be56-44a1-9e6d-643c9b067c92 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:42.075368 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-1e78f405-d746-43cb-b7b1-1c58fc76a67c req-4d63a4f0-be56-44a1-9e6d-643c9b067c92 service nova] Creating event network-vif-plugged:62c91794-515f-4658-9e18-73496cbc6fce for instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 on hv-cinder-84517 Jun 15 15:05:42.080192 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-1e78f405-d746-43cb-b7b1-1c58fc76a67c req-4d63a4f0-be56-44a1-9e6d-643c9b067c92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Jun 15 15:05:42.081089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 601/1230] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:42.325878 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:42.326896 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:42.338215 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:42.338681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:42.339468 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:42.339912 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:42.562544 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:42.569996 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-73c8a8ea-266d-4d9e-aff1-824fb50766a4 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.248986 Jun 15 15:05:42.570969 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 630/1231] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:42 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:43.587516 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:43.588208 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:43.595573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:43.596024 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:43.596794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:43.597231 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:43.734318 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:43.741650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a6efb20e-a0e2-4a28-a856-757e53e8cc5d tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1313 microversion: 2.1 time: 0.158402 Jun 15 15:05:43.742232 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 602/1232] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:43 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:44.759227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:44.759894 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:44.767929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:44.768390 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:44.769163 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:44.769625 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:44.990441 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:44.998228 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a4171275-22f1-4254-8275-a72c39989765 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1497 microversion: 2.1 time: 0.242969 Jun 15 15:05:44.998699 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 631/1233] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:44 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:05:46.148971 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:46.149535 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:46.167751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.167751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:46.167751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.167751 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:46.186268 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:05:46.511284 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-627781eb-74b1-4ed4-afc1-7bdabcdf18b0 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 204 len: 0 microversion: 2.1 time: 0.366175 Jun 15 15:05:46.511859 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 603/1234] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:05:46 2022] DELETE /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:05:46.520411 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:46.525460 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:46.527828 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.528287 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:46.529052 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:46.529494 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:46.662211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:46.670631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9a992c2d-7581-4f1f-9de6-097ea9830223 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1503 microversion: 2.1 time: 0.154074 Jun 15 15:05:46.671201 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 632/1235] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:46 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:47.689795 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:47.690589 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:47.697183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:47.697575 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:47.698393 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:47.698828 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:47.838049 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:47.845109 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-f6bcfbf5-e69a-423d-94c8-07d892f04e34 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1503 microversion: 2.1 time: 0.159391 Jun 15 15:05:47.845666 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 604/1236] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:47 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:48.862427 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:48.863035 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:48.869579 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:48.870025 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:48.870811 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:48.871251 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:48.963390 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:48.972388 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2617e129-10d7-45d9-8adf-6eb1a10ced87 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1461 microversion: 2.1 time: 0.113825 Jun 15 15:05:48.972960 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 633/1237] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:48 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1461 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:48.999773 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-bcaeb9b1-16ad-4250-b6f1-01924ad22fed req-31940e9f-9588-4184-8b01-bac40ffe9191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b387d3-28b3-4a8e-879b-2cafa7ef59d7", "name": "network-vif-deleted", "tag": "62c91794-515f-4658-9e18-73496cbc6fce"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:05:49.009266 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-bcaeb9b1-16ad-4250-b6f1-01924ad22fed req-31940e9f-9588-4184-8b01-bac40ffe9191 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.009715 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-bcaeb9b1-16ad-4250-b6f1-01924ad22fed req-31940e9f-9588-4184-8b01-bac40ffe9191 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.021563 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-bcaeb9b1-16ad-4250-b6f1-01924ad22fed req-31940e9f-9588-4184-8b01-bac40ffe9191 service nova] Creating event network-vif-deleted:62c91794-515f-4658-9e18-73496cbc6fce for instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 on hv-cinder-84517 Jun 15 15:05:49.030936 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-bcaeb9b1-16ad-4250-b6f1-01924ad22fed req-31940e9f-9588-4184-8b01-bac40ffe9191 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Jun 15 15:05:49.030936 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 605/1238] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:05:49.989239 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:49.990984 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:49.996788 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.997419 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:49.998370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:49.998954 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:50.036356 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:50.036852 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:50.037316 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lazy-loading 'fault' on Instance uuid e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:05:50.084747 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1314d2b3b8145bbb13aea98702d9b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c6a78958cb4d34862e51557f13d0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:05:50.093175 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a70e4955-5da8-4450-b5e2-9fbd099e9786 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 200 len: 1303 microversion: 2.1 time: 0.107795 Jun 15 15:05:50.093802 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 634/1239] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:49 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:05:51.112994 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:05:51.115033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] [instance: e2b387d3-28b3-4a8e-879b-2cafa7ef59d7] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:05:51.121211 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:51.121672 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:51.123044 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:05:51.123490 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:05:51.138501 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] HTTP exception thrown: Instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 could not be found. Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Request method failure captured: Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 HTTP/1.1 Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfUcWFzrIBTiUDU-cGsLxpmFYZDVCtJNu84mFqss9rDgA2wNX6Q09eemClCfo9TlCjTv-57PVTm-2OPoMN9xG71vJaH_qo_ZlvWlK_UkUQw1l_mFcKvBT98WCDtiVR2WePRAAFk8yrcZ6dIy5-s97Pf5zNqcyvSBzpb4seiogM3yfBA Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: a5c6a78958cb4d34862e51557f13d0b1 Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-VolumesActionsTest-1402300971 Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:05:51.140197 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a5c6a78958cb4d34862e51557f13d0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-VolumesActionsTest-1402300971 Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: a5c6a78958cb4d34862e51557f13d0b1 Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-VolumesActionsTest-1402300971 Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-VolumesActionsTest-1402300971-project Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: f1314d2b3b8145bbb13aea98702d9b43 Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-VolumesActionsTest-1402300971-project Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 could not be found. Jun 15 15:05:51.142608 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'e2b387d3-28b3-4a8e-879b-2cafa7ef59d7'} Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 could not be found. Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:05:51.143444 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 could not be found. Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 could not be found. Jun 15 15:05:51.144784 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:05:51.147400 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] Returning 404 to user: Instance e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:05:51.147400 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c573443c-c24b-4def-9fa6-8133ee22caf3 tempest-VolumesActionsTest-1402300971 tempest-VolumesActionsTest-1402300971-project] 10.222.0.23 "GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7" status: 404 len: 111 microversion: 2.1 time: 0.033736 Jun 15 15:05:51.147400 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 606/1240] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:05:51 2022] GET /compute/v2.1/servers/e2b387d3-28b3-4a8e-879b-2cafa7ef59d7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:06:01.994520 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:06:01.995115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Wed Jun 15 15:06:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:06:13.910186 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-897139658"}} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:13.910859 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:13.914105 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=13 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:13.914992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=40 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:13.923124 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:13.923795 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:13.931223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:13.931223 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:14.080358 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.network.security_group_api [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Removing security group 54986467-5a9c-4d24-920f-1a909ced329c from port 7da5816b-c50f-4fe3-9c64-d6a068219456 Jun 15 15:06:14.600848 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-430b9898-ad0e-4687-a695-1827c2edaa33 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/action" status: 202 len: 0 microversion: 2.1 time: 0.696172 Jun 15 15:06:14.602312 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 635/1241] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jun 15 15:06:13 2022] POST /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:06:14.624534 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-bc9c5c83-3cfd-480f-9014-5189d999302f req-8de645aa-aa56-4e25-bff4-8f659618616a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb303ec8-293e-4a9f-be0d-dbb848bdeb22", "tag": "7da5816b-c50f-4fe3-9c64-d6a068219456"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:14.633174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:14.633174 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:06:14.649101 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-bc9c5c83-3cfd-480f-9014-5189d999302f req-8de645aa-aa56-4e25-bff4-8f659618616a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:14.649567 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-bc9c5c83-3cfd-480f-9014-5189d999302f req-8de645aa-aa56-4e25-bff4-8f659618616a service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:14.704749 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-bc9c5c83-3cfd-480f-9014-5189d999302f req-8de645aa-aa56-4e25-bff4-8f659618616a service nova] Creating event network-changed:7da5816b-c50f-4fe3-9c64-d6a068219456 for instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 on hv-cinder-84517 Jun 15 15:06:14.721921 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-bc9c5c83-3cfd-480f-9014-5189d999302f req-8de645aa-aa56-4e25-bff4-8f659618616a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104086 Jun 15 15:06:14.722618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 607/1242] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:06:16.764642 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:16.766011 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:16.777992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:16.778690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:16.779681 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:16.780292 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:16.788412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-98523c09-8627-425d-8d6f-fba5de442a24 req-1742f964-20f2-4572-9e17-07b48a309bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb303ec8-293e-4a9f-be0d-dbb848bdeb22", "tag": "7da5816b-c50f-4fe3-9c64-d6a068219456"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:16.813576 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-98523c09-8627-425d-8d6f-fba5de442a24 req-1742f964-20f2-4572-9e17-07b48a309bb0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:16.814507 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-98523c09-8627-425d-8d6f-fba5de442a24 req-1742f964-20f2-4572-9e17-07b48a309bb0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:16.836246 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-98523c09-8627-425d-8d6f-fba5de442a24 req-1742f964-20f2-4572-9e17-07b48a309bb0 service nova] Creating event network-changed:7da5816b-c50f-4fe3-9c64-d6a068219456 for instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 on hv-cinder-84517 Jun 15 15:06:16.847566 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-98523c09-8627-425d-8d6f-fba5de442a24 req-1742f964-20f2-4572-9e17-07b48a309bb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063066 Jun 15 15:06:16.855312 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 608/1243] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:06:16.920291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lazy-loading 'services' on Instance uuid fb303ec8-293e-4a9f-be0d-dbb848bdeb22 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:06:17.165192 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-66d189a0-4454-402b-877a-6ba497608563 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments/5ba6e448-ebaf-4be8-b19c-3e4b40cb5357" status: 202 len: 0 microversion: 2.1 time: 0.405772 Jun 15 15:06:17.197829 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-814ef220-d95e-4847-acc7-d073a4692b45 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:17.199858 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-814ef220-d95e-4847-acc7-d073a4692b45 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:17.202819 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 636/1244] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:06:16 2022] DELETE /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments/5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:06:17.217699 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-814ef220-d95e-4847-acc7-d073a4692b45 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:17.221517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-814ef220-d95e-4847-acc7-d073a4692b45 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:17.223390 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-814ef220-d95e-4847-acc7-d073a4692b45 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:17.224127 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-814ef220-d95e-4847-acc7-d073a4692b45 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:17.259698 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-814ef220-d95e-4847-acc7-d073a4692b45 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067513 Jun 15 15:06:17.260704 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 609/1245] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:06:17 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:18.274843 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d39692b3-56d1-4a19-bc26-6f4e385bef53 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:18.276332 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d39692b3-56d1-4a19-bc26-6f4e385bef53 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:18.283684 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d39692b3-56d1-4a19-bc26-6f4e385bef53 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:18.284436 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d39692b3-56d1-4a19-bc26-6f4e385bef53 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:18.285562 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d39692b3-56d1-4a19-bc26-6f4e385bef53 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:18.286199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d39692b3-56d1-4a19-bc26-6f4e385bef53 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:18.325933 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d39692b3-56d1-4a19-bc26-6f4e385bef53 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056319 Jun 15 15:06:18.333296 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 637/1246] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:06:18 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:19.337877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dfdf688b-6e58-4f55-9358-39e7ba371b38 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:19.339995 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dfdf688b-6e58-4f55-9358-39e7ba371b38 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:19.348150 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfdf688b-6e58-4f55-9358-39e7ba371b38 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:19.348602 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfdf688b-6e58-4f55-9358-39e7ba371b38 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:19.349577 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfdf688b-6e58-4f55-9358-39e7ba371b38 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:19.350067 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dfdf688b-6e58-4f55-9358-39e7ba371b38 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:19.384470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dfdf688b-6e58-4f55-9358-39e7ba371b38 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050639 Jun 15 15:06:19.385055 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 610/1247] 10.222.0.23 () {58 vars in 1301 bytes} [Wed Jun 15 15:06:19 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:06:19.396023 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:19.396665 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:19.404093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:19.404527 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:19.405411 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:19.405830 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:19.498047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] HTTP exception thrown: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 is not attached to volume 5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Request method failure captured: Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: DELETE /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments/5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 HTTP/1.1 Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfTEqAWPNiaZFGmqI5-sjDnJugvQNCsShjl0PfCuOFvkTMsTkG8tQAaC6ec9qlevQmom_901xFJQCRTxcJ4bIOQSUvGqsfluQg82vq3NKEfusPWTH0Lf4iyeVYSfuwyWUSZpjLdI3WKPuYQRcXKIJDTUiqcvEIZf6OYIfdmmCT6hNWQ Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 019a9c2e2943403ab0700a96af732826 Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-TestMinimumBasicScenario-854722585 Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:06:19.503730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/019a9c2e2943403ab0700a96af732826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/019a9c2e2943403ab0700a96af732826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_019a9c2e2943403ab0700a96af732826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/019a9c2e2943403ab0700a96af732826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-TestMinimumBasicScenario-854722585 Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 019a9c2e2943403ab0700a96af732826 Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-TestMinimumBasicScenario-854722585 Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-TestMinimumBasicScenario-854722585-project Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 833efc71510e4bf8a5418671026a1b29 Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-TestMinimumBasicScenario-854722585-project Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:06:19.505483 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 is not attached to volume 5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'server_id': 'fb303ec8-293e-4a9f-be0d-dbb848bdeb22', 'id': '5ba6e448-ebaf-4be8-b19c-3e4b40cb5357'} Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5ba6e448-ebaf-4be8-b19c-3e4b40cb5357. Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:06:19.506462 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 is not attached to volume 5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 is not attached to volume 5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:06:19.508063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Returning 404 to user: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 is not attached to volume 5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:06:19.509229 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-fe6a2a07-7d5d-4741-9800-763403c638df tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments/5ba6e448-ebaf-4be8-b19c-3e4b40cb5357" status: 404 len: 154 microversion: 2.1 time: 0.113237 Jun 15 15:06:19.509229 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 638/1248] 10.222.0.23 () {58 vars in 1415 bytes} [Wed Jun 15 15:06:19 2022] DELETE /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22/os-volume_attachments/5ba6e448-ebaf-4be8-b19c-3e4b40cb5357 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:06:20.843919 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:20.844906 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:20.851275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:20.851722 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:20.852509 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:20.852943 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:20.886573 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:06:21.179471 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-5617ca47-93f4-4eea-8783-5ec1a44587e3 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 204 len: 0 microversion: 2.1 time: 0.340239 Jun 15 15:06:21.183716 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 611/1249] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:06:20 2022] DELETE /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:06:21.189072 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:21.189690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:21.196387 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:21.196835 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:21.198246 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:21.199452 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:21.410073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:21.419233 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a94abc37-1222-4b90-99a6-f365767a2049 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1555 microversion: 2.1 time: 0.234078 Jun 15 15:06:21.420351 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 639/1250] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:21 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:22.437122 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:22.437822 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:22.444459 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:22.444907 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:22.445741 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:22.446198 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:22.588560 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:22.596613 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-c9097bfc-715f-4187-aaa9-e2405d5bb797 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1555 microversion: 2.1 time: 0.163704 Jun 15 15:06:22.597183 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 612/1251] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:22 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:23.614697 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:23.615410 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:23.622999 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:23.623446 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:23.624213 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:23.624647 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:23.854712 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:23.862729 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-834dad83-c01c-4f17-bd01-ee775a59e160 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1555 microversion: 2.1 time: 0.251867 Jun 15 15:06:23.863418 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 640/1252] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:23 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1555 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:24.149458 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-7d68d294-959c-4b5a-80ee-1b46c33d8ff0 req-1718ae7f-39a7-4eaa-93c8-1f3f5066df6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb303ec8-293e-4a9f-be0d-dbb848bdeb22", "name": "network-vif-deleted", "tag": "7da5816b-c50f-4fe3-9c64-d6a068219456"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:06:24.158724 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-7d68d294-959c-4b5a-80ee-1b46c33d8ff0 req-1718ae7f-39a7-4eaa-93c8-1f3f5066df6c service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:24.159170 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-7d68d294-959c-4b5a-80ee-1b46c33d8ff0 req-1718ae7f-39a7-4eaa-93c8-1f3f5066df6c service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:24.170981 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-7d68d294-959c-4b5a-80ee-1b46c33d8ff0 req-1718ae7f-39a7-4eaa-93c8-1f3f5066df6c service nova] Creating event network-vif-deleted:7da5816b-c50f-4fe3-9c64-d6a068219456 for instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 on hv-cinder-84517 Jun 15 15:06:24.176151 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-7d68d294-959c-4b5a-80ee-1b46c33d8ff0 req-1718ae7f-39a7-4eaa-93c8-1f3f5066df6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030447 Jun 15 15:06:24.176748 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 613/1253] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:06:24.880902 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:24.881784 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:24.891188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:24.892874 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:24.896204 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:24.896701 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:24.931227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:24.931613 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:24.932063 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lazy-loading 'fault' on Instance uuid fb303ec8-293e-4a9f-be0d-dbb848bdeb22 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:06:24.982212 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833efc71510e4bf8a5418671026a1b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a9c2e2943403ab0700a96af732826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:06:24.992203 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-030af2a2-d441-41b4-8b36-0360125cc701 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 200 len: 1348 microversion: 2.1 time: 0.115605 Jun 15 15:06:24.993036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 641/1254] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:24 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:06:26.011866 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:26.012481 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] [instance: fb303ec8-293e-4a9f-be0d-dbb848bdeb22] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:06:26.019090 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:26.019546 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:26.020370 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:06:26.020967 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:06:26.036395 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] HTTP exception thrown: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 could not be found. Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Request method failure captured: Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 HTTP/1.1 Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfTEqAWPNiaZFGmqI5-sjDnJugvQNCsShjl0PfCuOFvkTMsTkG8tQAaC6ec9qlevQmom_901xFJQCRTxcJ4bIOQSUvGqsfluQg82vq3NKEfusPWTH0Lf4iyeVYSfuwyWUSZpjLdI3WKPuYQRcXKIJDTUiqcvEIZf6OYIfdmmCT6hNWQ Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 019a9c2e2943403ab0700a96af732826 Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-TestMinimumBasicScenario-854722585 Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:06:26.038398 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/019a9c2e2943403ab0700a96af732826"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/019a9c2e2943403ab0700a96af732826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_019a9c2e2943403ab0700a96af732826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/019a9c2e2943403ab0700a96af732826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-TestMinimumBasicScenario-854722585 Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 019a9c2e2943403ab0700a96af732826 Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-TestMinimumBasicScenario-854722585 Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-TestMinimumBasicScenario-854722585-project Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: 833efc71510e4bf8a5418671026a1b29 Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-TestMinimumBasicScenario-854722585-project Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 could not be found. Jun 15 15:06:26.040167 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'fb303ec8-293e-4a9f-be0d-dbb848bdeb22'} Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 could not be found. Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:06:26.041412 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 could not be found. Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 could not be found. Jun 15 15:06:26.043000 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:06:26.044233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Returning 404 to user: Instance fb303ec8-293e-4a9f-be0d-dbb848bdeb22 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:06:26.044233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-4d08b14c-d5f8-4b7a-9255-8d7cd5f70726 tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22" status: 404 len: 111 microversion: 2.1 time: 0.033642 Jun 15 15:06:26.044233 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 614/1255] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:06:26 2022] GET /compute/v2.1/servers/fb303ec8-293e-4a9f-be0d-dbb848bdeb22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:06:26.052103 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-2177d913-c89f-4f5d-a42e-04de94997f0a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] Calling method '.version_select at 0x7f69434f5a60>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:06:26.155969 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-2177d913-c89f-4f5d-a42e-04de94997f0a tempest-TestMinimumBasicScenario-854722585 tempest-TestMinimumBasicScenario-854722585-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1774682568" status: 202 len: 0 microversion: 2.1 time: 0.109534 Jun 15 15:06:26.156688 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 642/1256] 10.222.0.23 () {58 vars in 1271 bytes} [Wed Jun 15 15:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1774682568 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:07:13.858491 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-220906596", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-284020389", "security_groups": [{"name": "tempest-secgroup-smoke-2103269246"}], "block_device_mapping_v2": [{"uuid": "0f884dda-6337-44ee-8a95-c979d2e7d4e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5d513a22-cd88-4063-a54c-439ca917eee0"}]}} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:07:13.868070 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:13.868754 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:13.972526 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.network.neutron [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] validate_networks() for [('5d513a22-cd88-4063-a54c-439ca917eee0', None, None, None, None, None)] {{(pid=124695) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:07:14.414823 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Flavor limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:07:14.415254 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Image limits 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:07:14.415737 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Flavor pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:07:14.416150 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Image pref 0:0:0 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:07:14.416570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.virt.hardware [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124695) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:07:14.425601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:14.426051 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:14.426970 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:14.427415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:14.445648 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for project 547883446fb944e4811768d29eb67583. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:07:14.449607 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.quota [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Getting quotas for user 71f3bb1357f14481bd1850c1153bc253 and project 547883446fb944e4811768d29eb67583. Resources: {'ram', 'instances', 'cores'} {{(pid=124695) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:07:14.509718 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Going to run 1 instances... {{(pid=124695) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:07:14.511956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f884dda-6337-44ee-8a95-c979d2e7d4e5',volume_size=None,volume_type=None)] {{(pid=124695) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:07:14.995769 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-473e7c57-1659-4e0c-a147-937fc163dc9f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.141350 Jun 15 15:07:14.996668 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 615/1257] 10.222.0.23 () {60 vars in 1146 bytes} [Wed Jun 15 15:07:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:07:15.004690 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:15.005537 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:15.009667 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9834a7a6-2190-46f7-9bdc-4b88f0834242 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:15.010298 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9834a7a6-2190-46f7-9bdc-4b88f0834242 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:15.063932 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9834a7a6-2190-46f7-9bdc-4b88f0834242 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:15.071340 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9834a7a6-2190-46f7-9bdc-4b88f0834242 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1093 microversion: 2.1 time: 0.068172 Jun 15 15:07:15.071891 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 643/1258] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:15 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:16.089319 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-64089d70-ca09-4218-8f5e-8d4ad5bce3e0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:16.089882 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-64089d70-ca09-4218-8f5e-8d4ad5bce3e0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:16.142535 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-64089d70-ca09-4218-8f5e-8d4ad5bce3e0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:16.149236 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-64089d70-ca09-4218-8f5e-8d4ad5bce3e0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1093 microversion: 2.1 time: 0.064348 Jun 15 15:07:16.149790 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 616/1259] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:16 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:17.166631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:17.167229 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:17.174987 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:17.175437 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:17.176199 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:17.176635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:17.240994 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:17.248416 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b80ad249-8811-4561-9b23-bac510952c1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1191 microversion: 2.1 time: 0.086044 Jun 15 15:07:17.249056 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 644/1260] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:17 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:18.264846 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:18.265391 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:18.271915 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:18.272372 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:18.273169 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:18.273614 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:18.493275 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:18.501115 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d2327f40-d0dc-46b1-8529-d80e65859d20 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1277 microversion: 2.1 time: 0.240109 Jun 15 15:07:18.501695 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 617/1261] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:18 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:19.518381 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:19.519299 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:19.530221 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:19.530221 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:19.530221 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:19.530221 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:19.705084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:19.716655 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5a859cba-1431-4e9f-a6ac-7e8c3e578031 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.202375 Jun 15 15:07:19.717392 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 645/1262] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:19 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:19.725229 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-a7d953e6-d999-4d5c-9db1-1745a0cccb8a req-8fc55555-0325-4341-81fb-b0598aeefb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50027713-efd3-4fc4-a1fb-51a09b1398e6", "tag": "17dbe9aa-9fb7-4c79-a1b6-998723489fd4"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:07:19.734102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-a7d953e6-d999-4d5c-9db1-1745a0cccb8a req-8fc55555-0325-4341-81fb-b0598aeefb02 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:19.735589 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-a7d953e6-d999-4d5c-9db1-1745a0cccb8a req-8fc55555-0325-4341-81fb-b0598aeefb02 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:19.748199 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-a7d953e6-d999-4d5c-9db1-1745a0cccb8a req-8fc55555-0325-4341-81fb-b0598aeefb02 service nova] Creating event network-changed:17dbe9aa-9fb7-4c79-a1b6-998723489fd4 for instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 on hv-cinder-84517 Jun 15 15:07:19.754207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-a7d953e6-d999-4d5c-9db1-1745a0cccb8a req-8fc55555-0325-4341-81fb-b0598aeefb02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183783 Jun 15 15:07:19.754794 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 618/1263] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:07:20.735982 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:20.736687 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:20.743861 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:20.744326 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:20.745111 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:20.745558 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:20.953774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:20.961422 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-7f06888f-fe2b-43cb-b06e-331944169eef tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.230141 Jun 15 15:07:20.961990 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 646/1264] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:20 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:21.979046 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:21.979757 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:21.986201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:21.986668 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:21.987435 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:21.987878 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:22.122736 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:22.130898 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-47dff37a-6028-4b5d-9672-5109a2b910b1 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.156644 Jun 15 15:07:22.131480 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 619/1265] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:21 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:23.147768 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:23.148388 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:23.154849 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:23.155292 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:23.156729 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:23.157579 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:23.288972 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:23.297302 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-b5b96996-46de-44e7-9515-0c5bac502f11 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.153315 Jun 15 15:07:23.297862 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 647/1266] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:23 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:24.314415 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:24.315059 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:24.322572 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:24.323028 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:24.323970 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:24.324408 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:24.436158 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=2 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:24.455230 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:24.462692 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-978552d9-013f-419a-b28d-173cd82b241e tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.152645 Jun 15 15:07:24.463256 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 620/1267] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:24 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:25.479946 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:25.480559 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:25.482947 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell0:SELECT=2 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:25.488184 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:25.488650 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:25.489424 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:25.489863 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:25.618706 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:25.626211 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-860e10a4-a588-4b76-adc7-1c6af9a8fc44 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.150081 Jun 15 15:07:25.626844 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 648/1268] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:25 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:26.643711 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:26.644333 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:26.646759 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell0:SELECT=8 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:07:26.652255 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:26.655404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:26.655404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:26.655404 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:26.790641 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:26.799124 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7e6b3ff3-bdd0-4987-8243-4bdd3d321ba3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.159703 Jun 15 15:07:26.799683 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 621/1269] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:26 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:27.816597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:27.817209 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:27.823842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:27.824290 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:27.825067 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:27.825499 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:27.956145 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:27.963592 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e445d653-2627-402d-812e-8f56c42aba77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.151733 Jun 15 15:07:27.964143 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 649/1270] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:27 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:28.980584 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:28.981199 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:28.988406 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:28.989547 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:28.990380 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:28.990821 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:29.129079 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:29.136509 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-20702638-3ee7-474d-b1a0-9ba3b69b68ab tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.159777 Jun 15 15:07:29.137072 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 622/1271] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:28 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:30.153280 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:30.153831 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:30.160842 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:30.161296 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:30.162065 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:30.162532 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:30.294377 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:30.302589 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-5b4dbf1f-aaf8-472f-b189-95165dd0eca3 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.153285 Jun 15 15:07:30.303293 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 650/1272] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:30 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:31.000333 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-3199c523-6de2-46d6-ba35-9bb88b9cd994 req-f60a02ff-cf79-486d-9ac5-a9d178c53fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50027713-efd3-4fc4-a1fb-51a09b1398e6", "name": "network-vif-plugged", "status": "completed", "tag": "17dbe9aa-9fb7-4c79-a1b6-998723489fd4"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:07:31.008346 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-3199c523-6de2-46d6-ba35-9bb88b9cd994 req-f60a02ff-cf79-486d-9ac5-a9d178c53fc0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:31.008796 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-3199c523-6de2-46d6-ba35-9bb88b9cd994 req-f60a02ff-cf79-486d-9ac5-a9d178c53fc0 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:31.019685 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-3199c523-6de2-46d6-ba35-9bb88b9cd994 req-f60a02ff-cf79-486d-9ac5-a9d178c53fc0 service nova] Creating event network-vif-plugged:17dbe9aa-9fb7-4c79-a1b6-998723489fd4 for instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 on hv-cinder-84517 Jun 15 15:07:31.024705 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-3199c523-6de2-46d6-ba35-9bb88b9cd994 req-f60a02ff-cf79-486d-9ac5-a9d178c53fc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084786 Jun 15 15:07:31.025291 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 623/1273] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:07:31.320030 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:31.320648 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:31.327232 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:31.328262 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:31.329084 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:31.329526 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:31.519324 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:31.526884 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-9c2f0254-2822-4aa7-83e5-8422eaeb61be tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.210726 Jun 15 15:07:31.527460 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 651/1274] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:31 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:32.545179 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:32.545891 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:32.552650 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:32.553110 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:32.553889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:32.554360 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:32.684191 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:32.692306 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-d7b82f38-ab71-4bc6-9890-132500669bff tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1265 microversion: 2.1 time: 0.151935 Jun 15 15:07:32.692876 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 624/1275] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:32 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:33.709130 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:33.709770 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:33.716827 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:33.717284 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:33.718078 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:33.718623 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:33.856139 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:33.864214 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-d7362311-ad82-41e9-b658-9c7d9a23b297 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1451 microversion: 2.1 time: 0.158968 Jun 15 15:07:33.864774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 652/1276] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:33 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:33.880975 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:07:33.881617 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:07:33.889102 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:33.889549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:33.890343 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:33.890877 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:34.021524 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:07:34.029011 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-dc0eb050-9cb0-44dc-8089-c0b23ffeccac tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1451 microversion: 2.1 time: 0.151899 Jun 15 15:07:34.029574 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 625/1277] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:07:33 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:07:36.448866 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-3ed4613a-ae52-4285-acee-9534aa80117e req-ff90fae0-34b9-458e-8b15-505d2e4b55d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50027713-efd3-4fc4-a1fb-51a09b1398e6", "tag": "17dbe9aa-9fb7-4c79-a1b6-998723489fd4"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:07:36.459000 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3ed4613a-ae52-4285-acee-9534aa80117e req-ff90fae0-34b9-458e-8b15-505d2e4b55d8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:07:36.459655 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-3ed4613a-ae52-4285-acee-9534aa80117e req-ff90fae0-34b9-458e-8b15-505d2e4b55d8 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:07:36.472407 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-3ed4613a-ae52-4285-acee-9534aa80117e req-ff90fae0-34b9-458e-8b15-505d2e4b55d8 service nova] Creating event network-changed:17dbe9aa-9fb7-4c79-a1b6-998723489fd4 for instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 on hv-cinder-84517 Jun 15 15:07:36.477775 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-3ed4613a-ae52-4285-acee-9534aa80117e req-ff90fae0-34b9-458e-8b15-505d2e4b55d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032943 Jun 15 15:07:36.478471 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 653/1278] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:09:10.768224 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:09:10.769017 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Wed Jun 15 15:09:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:09:16.137113 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:09:16.137873 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG dbcounter [-] [124695] Writing DB stats nova_cell1:SELECT=48 {{(pid=124695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:09:16.140406 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8da93c3-10fb-4f7d-99d5-27b012dcdcc6] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 15:09:16.141093 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_api:SELECT=24 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:09:16.141884 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:16.142015 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG dbcounter [-] [124694] Writing DB stats nova_cell1:SELECT=56 {{(pid=124694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:09:16.142416 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:16.147119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-478d8e60-f45d-4933-b13e-c80d426322ab req-d1626bdd-5a18-47f5-9a95-c26e45d48e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50027713-efd3-4fc4-a1fb-51a09b1398e6", "tag": "17dbe9aa-9fb7-4c79-a1b6-998723489fd4"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:09:16.149104 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:16.149570 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:16.150517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:16.151146 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:16.161268 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-478d8e60-f45d-4933-b13e-c80d426322ab req-d1626bdd-5a18-47f5-9a95-c26e45d48e14 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:16.162469 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-478d8e60-f45d-4933-b13e-c80d426322ab req-d1626bdd-5a18-47f5-9a95-c26e45d48e14 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:16.174493 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-478d8e60-f45d-4933-b13e-c80d426322ab req-d1626bdd-5a18-47f5-9a95-c26e45d48e14 service nova] Creating event network-changed:17dbe9aa-9fb7-4c79-a1b6-998723489fd4 for instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 on hv-cinder-84517 Jun 15 15:09:16.180540 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-478d8e60-f45d-4933-b13e-c80d426322ab req-d1626bdd-5a18-47f5-9a95-c26e45d48e14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041449 Jun 15 15:09:16.180929 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 654/1279] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:09:16.183823 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Going to try to terminate instance {{(pid=124695) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:09:16.569932 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-698b72b0-467e-48d9-930f-816ee77aa98f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 204 len: 0 microversion: 2.1 time: 0.434411 Jun 15 15:09:16.572543 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 626/1280] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:09:16 2022] DELETE /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:09:16.581965 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:16.583036 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:16.590597 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:16.591302 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:16.592082 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:16.593147 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:16.736463 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:16.746000 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-162188ea-83bb-448b-afff-d23a07cdbb46 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1575 microversion: 2.1 time: 0.169027 Jun 15 15:09:16.746730 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 655/1281] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:16 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:09:17.765517 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:17.766311 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:17.774470 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:17.774918 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:17.775676 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:17.776106 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:17.910579 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:17.919159 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-1f993a17-dd47-4b8e-ae7b-2cb2854e5a6c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1575 microversion: 2.1 time: 0.157938 Jun 15 15:09:17.919767 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 627/1282] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:17 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:09:18.936568 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:18.937291 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:18.946816 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:18.947266 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:18.948041 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:18.948474 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:18.954276 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8da93c3-10fb-4f7d-99d5-27b012dcdcc6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36006. Jun 15 15:09:19.110992 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:19.123117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-21648afc-cc52-4ed6-970d-57e17e78634a tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1457 microversion: 2.1 time: 0.188061 Jun 15 15:09:19.123117 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 656/1283] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:18 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1457 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:09:19.201409 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-249b182b-f2d6-43df-8dbf-aa305e687f62 req-17b35519-7673-4685-a2f7-12c223638d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50027713-efd3-4fc4-a1fb-51a09b1398e6", "name": "network-vif-deleted", "tag": "17dbe9aa-9fb7-4c79-a1b6-998723489fd4"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:09:19.210461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-249b182b-f2d6-43df-8dbf-aa305e687f62 req-17b35519-7673-4685-a2f7-12c223638d9d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:19.216920 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-249b182b-f2d6-43df-8dbf-aa305e687f62 req-17b35519-7673-4685-a2f7-12c223638d9d service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:19.222036 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-249b182b-f2d6-43df-8dbf-aa305e687f62 req-17b35519-7673-4685-a2f7-12c223638d9d service nova] Creating event network-vif-deleted:17dbe9aa-9fb7-4c79-a1b6-998723489fd4 for instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 on hv-cinder-84517 Jun 15 15:09:19.227844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-249b182b-f2d6-43df-8dbf-aa305e687f62 req-17b35519-7673-4685-a2f7-12c223638d9d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 Jun 15 15:09:19.228437 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 628/1284] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:09:20.137476 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:20.138047 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:20.144635 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:20.145080 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:20.145844 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:20.146353 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:20.178752 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:20.179205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:20.179664 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.objects.instance [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lazy-loading 'fault' on Instance uuid 50027713-efd3-4fc4-a1fb-51a09b1398e6 {{(pid=124694) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:09:20.221365 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:20.229584 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-c4a0c5c4-cd84-4162-97ed-e829a847df68 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 200 len: 1229 microversion: 2.1 time: 0.095930 Jun 15 15:09:20.230144 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 657/1285] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:20 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:09:21.247580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:21.248310 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 50027713-efd3-4fc4-a1fb-51a09b1398e6] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:21.254493 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:21.254945 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:21.256282 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:21.256717 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:21.270145 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] HTTP exception thrown: Instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 could not be found. Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Request method failure captured: Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 HTTP/1.1 Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfQ-HxDYA1tXp141t3UiLVyF8HbI3_GJX5J7OZeyl512g_sqE5tU3Jc7KT12dSFsI5qMgK7BGZvNgGMwOLA8SSJPsmRrFHmE1wj0wd7HLj0LbY090sN4CflS6z3T8Ggt1IxttMeQMEXklS9_PeGg19FHf1X2a_fHi4nxPvJ2C6doL6o Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:09:21.272580 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_547883446fb944e4811768d29eb67583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/547883446fb944e4811768d29eb67583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: 71f3bb1357f14481bd1850c1153bc253 Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 could not be found. Jun 15 15:09:21.274461 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': '50027713-efd3-4fc4-a1fb-51a09b1398e6'} Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 could not be found. Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:09:21.275399 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 could not be found. Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 could not be found. Jun 15 15:09:21.276844 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:21.278143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Returning 404 to user: Instance 50027713-efd3-4fc4-a1fb-51a09b1398e6 could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:09:21.278143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-26b98a15-2b06-4b8b-b8e4-f3b4a1ec7f1f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6" status: 404 len: 111 microversion: 2.1 time: 0.031255 Jun 15 15:09:21.278143 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 629/1286] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:21 2022] GET /compute/v2.1/servers/50027713-efd3-4fc4-a1fb-51a09b1398e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:09:22.004333 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:09:22.004590 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Wed Jun 15 15:09:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:09:24.957778 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:24.959000 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:24.960872 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [req-dc01cdf7-b341-4b83-9da7-a8dbf80e115a req-5fd487d7-08c2-49ef-b0b1-166cd4a39162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c8eb50-430f-4bb0-ac09-d39f5934e4c3", "tag": "e2129264-53e0-42b2-94ef-9136de45ac6b"}]} {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:09:24.966432 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:24.966897 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:24.967722 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:24.968166 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:24.971280 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-dc01cdf7-b341-4b83-9da7-a8dbf80e115a req-5fd487d7-08c2-49ef-b0b1-166cd4a39162 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:24.971798 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [req-dc01cdf7-b341-4b83-9da7-a8dbf80e115a req-5fd487d7-08c2-49ef-b0b1-166cd4a39162 service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:24.984601 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.compute.server_external_events [req-dc01cdf7-b341-4b83-9da7-a8dbf80e115a req-5fd487d7-08c2-49ef-b0b1-166cd4a39162 service nova] Creating event network-changed:e2129264-53e0-42b2-94ef-9136de45ac6b for instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 on hv-cinder-84517 Jun 15 15:09:24.990927 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [req-dc01cdf7-b341-4b83-9da7-a8dbf80e115a req-5fd487d7-08c2-49ef-b0b1-166cd4a39162 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033984 Jun 15 15:09:24.992014 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 630/1287] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:09:24.998070 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Going to try to terminate instance {{(pid=124694) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:09:25.347833 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-8f1e3a70-25be-47be-8898-553ab50ce1df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 204 len: 0 microversion: 2.1 time: 0.393733 Jun 15 15:09:25.348608 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 658/1288] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:09:24 2022] DELETE /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:09:25.357548 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:25.368558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:25.368558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:25.368558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:25.368558 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:25.369215 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:25.544403 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:25.552706 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-29c82783-dd30-450c-be07-2747aac50d7c tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1578 microversion: 2.1 time: 0.198710 Jun 15 15:09:25.553288 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 631/1289] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:25 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:09:26.572188 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:26.572886 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:26.579453 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:26.579910 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:26.580670 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:26.581108 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:26.716664 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.policy [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124694) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:26.724512 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-e3f5b98e-7c9b-4eec-96f0-24ee5b773b5f tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1578 microversion: 2.1 time: 0.157789 Jun 15 15:09:26.725079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 659/1290] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:26 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:09:27.742037 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:27.742694 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:27.749436 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:27.749895 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:27.750750 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:27.751189 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:27.901675 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:27.909438 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-897e510d-c413-4e23-90e3-a4e046fa3a96 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1459 microversion: 2.1 time: 0.171835 Jun 15 15:09:27.910033 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 632/1291] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:27 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:09:28.007516 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [req-ee18d951-0969-459e-937c-87b06fd8f9dd req-4e74aa29-b4fc-4405-90ba-b609897c731e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c8eb50-430f-4bb0-ac09-d39f5934e4c3", "name": "network-vif-deleted", "tag": "e2129264-53e0-42b2-94ef-9136de45ac6b"}]} {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:09:28.016095 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-ee18d951-0969-459e-937c-87b06fd8f9dd req-4e74aa29-b4fc-4405-90ba-b609897c731e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:28.016535 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [req-ee18d951-0969-459e-937c-87b06fd8f9dd req-4e74aa29-b4fc-4405-90ba-b609897c731e service nova] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:28.029394 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.compute.server_external_events [req-ee18d951-0969-459e-937c-87b06fd8f9dd req-4e74aa29-b4fc-4405-90ba-b609897c731e service nova] Creating event network-vif-deleted:e2129264-53e0-42b2-94ef-9136de45ac6b for instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 on hv-cinder-84517 Jun 15 15:09:28.036079 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [req-ee18d951-0969-459e-937c-87b06fd8f9dd req-4e74aa29-b4fc-4405-90ba-b609897c731e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032373 Jun 15 15:09:28.036287 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 660/1292] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Jun 15 15:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:09:28.927224 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:28.927961 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:28.934137 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:28.934618 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:28.935391 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:28.935853 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:28.968956 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:28.969402 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:28.969848 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.objects.instance [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lazy-loading 'fault' on Instance uuid 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 {{(pid=124695) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:09:29.014565 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.policy [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71f3bb1357f14481bd1850c1153bc253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547883446fb944e4811768d29eb67583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124695) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:09:29.022643 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-a1e9407f-7c5c-4ed8-ae4e-27e37c7a4983 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 200 len: 1230 microversion: 2.1 time: 0.099831 Jun 15 15:09:29.023201 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 633/1293] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:28 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:09:30.040454 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:30.041194 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: 46c8eb50-430f-4bb0-ac09-d39f5934e4c3] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:30.048004 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:30.048459 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:30.049227 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:30.049671 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:30.065926 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] HTTP exception thrown: Instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 could not be found. Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Request method failure captured: Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 HTTP/1.1 Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfQ-HxDYA1tXp141t3UiLVyF8HbI3_GJX5J7OZeyl512g_sqE5tU3Jc7KT12dSFsI5qMgK7BGZvNgGMwOLA8SSJPsmRrFHmE1wj0wd7HLj0LbY090sN4CflS6z3T8Ggt1IxttMeQMEXklS9_PeGg19FHf1X2a_fHi4nxPvJ2C6doL6o Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:09:30.067622 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_547883446fb944e4811768d29eb67583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/547883446fb944e4811768d29eb67583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 71f3bb1357f14481bd1850c1153bc253 Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 could not be found. Jun 15 15:09:30.069205 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': '46c8eb50-430f-4bb0-ac09-d39f5934e4c3'} Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 could not be found. Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:09:30.070119 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 could not be found. Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 could not be found. Jun 15 15:09:30.071920 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.074114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Returning 404 to user: Instance 46c8eb50-430f-4bb0-ac09-d39f5934e4c3 could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:09:30.074114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-45560832-d9ba-4cad-8ff9-74a2bc3c23df tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3" status: 404 len: 111 microversion: 2.1 time: 0.033415 Jun 15 15:09:30.074114 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 661/1294] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:30 2022] GET /compute/v2.1/servers/46c8eb50-430f-4bb0-ac09-d39f5934e4c3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:09:30.648207 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:30.648733 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.compute.api [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124695) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:30.655438 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:30.655889 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:30.656653 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:30.657089 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG oslo_concurrency.lockutils [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124695) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:30.670886 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.wsgi [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] HTTP exception thrown: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Request method failure captured: Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: request: DELETE /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a HTTP/1.1 Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept: application/json Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Accept-Encoding: identity Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Connection: close Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Length: 0 Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Content-Type: application/json Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Host: 10.222.0.23 Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Openstack-System-Scope: None Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: User-Agent: python-urllib3/1.26.9 Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Auth-Token: gAAAAABiqfQ-HxDYA1tXp141t3UiLVyF8HbI3_GJX5J7OZeyl512g_sqE5tU3Jc7KT12dSFsI5qMgK7BGZvNgGMwOLA8SSJPsmRrFHmE1wj0wd7HLj0LbY090sN4CflS6z3T8Ggt1IxttMeQMEXklS9_PeGg19FHf1X2a_fHi4nxPvJ2C6doL6o Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Id: None Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Domain-Name: None Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Identity-Status: Confirmed Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Is-Admin-Project: True Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Id: default Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Domain-Name: Default Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Project-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Role: reader,member Jun 15 15:09:30.672529 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Roles: reader,member Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_547883446fb944e4811768d29eb67583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/547883446fb944e4811768d29eb67583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-Tenant-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Id: default Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Domain-Name: Default Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Id: 71f3bb1357f14481bd1850c1153bc253 Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: X-User-Name: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: method: > Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: exception: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.674321 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: action_args: {'id': 'fbf20221-daaa-4dc2-87d6-a23729ea9a0a'} Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:09:30.675187 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.676571 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.678078 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Returning 404 to user: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. {{(pid=124695) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:09:30.678078 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-86e5ccf3-cab0-4c0c-96ff-70eebd60ef77 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 404 len: 111 microversion: 2.1 time: 0.030238 Jun 15 15:09:30.678078 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 634/1295] 10.222.0.23 () {58 vars in 1238 bytes} [Wed Jun 15 15:09:30 2022] DELETE /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:09:30.682882 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '>' {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:30.683574 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.compute.api [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] [instance: fbf20221-daaa-4dc2-87d6-a23729ea9a0a] Fetching instance by UUID {{(pid=124694) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:09:30.689743 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:30.690253 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:30.691018 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:09:30.691451 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG oslo_concurrency.lockutils [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Lock "bbffb719-9963-4c10-ac0c-7cdf90539028" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124694) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:09:30.705207 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.wsgi [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] HTTP exception thrown: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Request method failure captured: Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: request: GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a HTTP/1.1 Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept: application/json Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Accept-Encoding: identity Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Connection: close Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Length: 0 Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Content-Type: application/json Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Host: 10.222.0.23 Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Openstack-System-Scope: None Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: User-Agent: python-urllib3/1.26.9 Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Auth-Token: gAAAAABiqfQ-HxDYA1tXp141t3UiLVyF8HbI3_GJX5J7OZeyl512g_sqE5tU3Jc7KT12dSFsI5qMgK7BGZvNgGMwOLA8SSJPsmRrFHmE1wj0wd7HLj0LbY090sN4CflS6z3T8Ggt1IxttMeQMEXklS9_PeGg19FHf1X2a_fHi4nxPvJ2C6doL6o Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Id: None Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Domain-Name: None Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Identity-Status: Confirmed Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Is-Admin-Project: True Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Id: default Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Domain-Name: Default Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Project-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Role: reader,member Jun 15 15:09:30.706774 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Roles: reader,member Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/547883446fb944e4811768d29eb67583"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_547883446fb944e4811768d29eb67583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/547883446fb944e4811768d29eb67583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/"}]}] Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Id: 547883446fb944e4811768d29eb67583 Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-Tenant-Name: tempest-TestVolumeBootPattern-395749310 Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Id: default Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Domain-Name: Default Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Id: 71f3bb1357f14481bd1850c1153bc253 Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: X-User-Name: tempest-TestVolumeBootPattern-395749310-project Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: method: > Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: exception: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.709242 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: action_args: {'id': 'fbf20221-daaa-4dc2-87d6-a23729ea9a0a'} Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: {{(pid=124694) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:09:30.710073 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. Jun 15 15:09:30.711796 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: ERROR nova.api.openstack.wsgi Jun 15 15:09:30.713154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: DEBUG nova.api.openstack.wsgi [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Returning 404 to user: Instance fbf20221-daaa-4dc2-87d6-a23729ea9a0a could not be found. {{(pid=124694) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:09:30.713154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO nova.api.openstack.requestlog [None req-a4cf776b-f21f-40c1-9e4e-4c132c9beea4 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a" status: 404 len: 111 microversion: 2.1 time: 0.029316 Jun 15 15:09:30.713154 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: [pid: 124694|app: 0|req: 662/1296] 10.222.0.23 () {58 vars in 1235 bytes} [Wed Jun 15 15:09:30 2022] GET /compute/v2.1/servers/fbf20221-daaa-4dc2-87d6-a23729ea9a0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:09:32.287856 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: DEBUG nova.api.openstack.wsgi [None req-7bf72ab6-0ea4-4707-8866-39bcb97a07f0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] Calling method '.version_select at 0x7f693a9e1310>' {{(pid=124695) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:09:32.408892 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO nova.api.openstack.requestlog [None req-7bf72ab6-0ea4-4707-8866-39bcb97a07f0 tempest-TestVolumeBootPattern-395749310 tempest-TestVolumeBootPattern-395749310-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-284020389" status: 202 len: 0 microversion: 2.1 time: 0.137696 Jun 15 15:09:32.409460 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: [pid: 124695|app: 0|req: 635/1297] 10.222.0.23 () {58 vars in 1259 bytes} [Wed Jun 15 15:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-284020389 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:11:04.160711 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:11:04.161370 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Wed Jun 15 15:11:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:12:18.801830 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:12:18.802492 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Wed Jun 15 15:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:12:30.778631 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:12:30.779258 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Wed Jun 15 15:12:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:12:38.084319 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:12:38.085023 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Wed Jun 15 15:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:12:42.013586 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:12:42.013586 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Wed Jun 15 15:12:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:14:24.169466 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:14:24.170128 dv-cinder-845178-7-iscsi devstack@n-api.service[124694]: Wed Jun 15 15:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:14:36.151680 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:14:36.152549 dv-cinder-845178-7-iscsi devstack@n-api.service[124695]: Wed Jun 15 15:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!